-- Logs begin at Mon 2021-12-20 05:13:01 UTC, end at Mon 2021-12-20 06:11:13 UTC. -- Dec 20 05:45:14.413782 dv-cinder-822278-1-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Dec 20 05:45:17.304279 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.common.config [-] Logging enabled! Dec 20 05:45:17.305411 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev293 Dec 20 05:45:17.305659 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102336) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 20 05:45:17.308994 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.common.config [-] Logging enabled! Dec 20 05:45:17.309256 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev293 Dec 20 05:45:17.309577 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102336) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 20 05:45:17.310523 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 20 05:45:17.310760 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 20 05:45:17.311129 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 20 05:45:17.311377 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 20 05:45:17.311648 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 20 05:45:17.311969 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.312390 dv-cinder-822278-1-iscsi neutron-server[102336]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Dec 20 05:45:17.312707 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.313005 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.313301 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.313602 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.313897 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.314191 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.314483 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.314783 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.315070 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.315352 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.315660 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.315961 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.316251 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] config_source = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.316542 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.316834 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.317122 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] debug = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.317406 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.317844 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.318268 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.318555 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.318846 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.319129 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.319406 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.319716 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.320003 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.320386 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] host = dv-cinder-822278-1-iscsi {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.321198 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.321493 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.321786 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.322075 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.322356 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.322635 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.322923 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.323200 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] log_dir = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.323477 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] log_file = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.323782 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.324073 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.324364 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.324655 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.324884 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.325378 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.325679 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.325970 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.326251 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.326532 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.326814 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.327094 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.327381 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.327676 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.327972 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.328258 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.328547 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.328828 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.329107 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.329381 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.329659 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.329947 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.330225 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.330505 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.330782 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.331158 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.331345 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.331647 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.331953 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.332242 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.332529 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.332819 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.333098 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.333384 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.333660 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.333934 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] use_journal = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.334209 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] use_json = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.334508 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.334788 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.335077 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.335353 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.335657 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.335965 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.336242 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.336530 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:17.336832 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.337133 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.337434 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.337720 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.338034 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.338323 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.338609 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.338890 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.339187 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.339479 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.339794 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.340076 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.340394 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.340643 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.340940 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.341245 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.341542 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.341834 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.342112 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.342386 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.342661 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.342941 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.343232 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.343539 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.343823 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.344116 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.344399 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.344702 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.344991 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.345289 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.345581 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.345857 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.346137 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.346429 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.346708 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.346982 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.347263 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.347575 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.347859 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.348133 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.348419 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.348693 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.348968 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.349241 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.349524 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.349810 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.350088 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.350365 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.350633 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.350911 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.351183 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.351471 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.351795 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.352070 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.352342 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.352620 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.352894 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.353170 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.353451 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.353727 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.354006 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.354278 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.354556 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.354830 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.355104 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.355377 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.355676 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.355956 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.356237 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.356513 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.356787 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.357063 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.357341 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.357616 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.357904 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.358201 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.358513 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.358760 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.359043 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.359660 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.359660 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.359884 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.360166 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.360451 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.360723 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.361015 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.361303 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.361592 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.361878 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.362177 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.362473 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.362754 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.363044 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.363345 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.363642 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.363935 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.364228 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.364556 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.364828 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.365129 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.365430 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.365726 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.366011 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.366325 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.366606 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:17.366827 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 20 05:45:17.367070 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=102336) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Dec 20 05:45:17.794575 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=102336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 05:45:17.794848 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=102336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 05:45:17.795157 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=102336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 20 05:45:17.795532 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.manager [-] Loading core plugin: ml2 Dec 20 05:45:18.130974 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.131293 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.131702 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.133783 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.134068 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.134337 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.180261 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.180549 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.180819 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.194737 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.195021 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.195940 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.224627 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.224915 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.225188 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.264043 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.264319 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.264586 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.605871 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.606482 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.606482 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.606679 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.607373 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.710793 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.711068 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.711355 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.711658 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.711930 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.712242 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.712502 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.712761 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.713016 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.713300 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.713557 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.713821 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.714075 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.714325 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.714582 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.714848 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.715114 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.715381 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.715681 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.715941 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.716221 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.716476 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.716758 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.717146 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.717398 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.717645 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.718054 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=102336) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 20 05:45:18.718296 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=102336) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 20 05:45:18.718535 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=102336) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 20 05:45:18.718776 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=102336) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 20 05:45:18.719014 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=102336) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 20 05:45:18.719252 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=102336) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 20 05:45:18.719649 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Dec 20 05:45:18.723103 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Dec 20 05:45:18.727609 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Dec 20 05:45:18.731797 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(400, 449)])]) Dec 20 05:45:18.733479 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Dec 20 05:45:18.733953 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Dec 20 05:45:18.734292 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Dec 20 05:45:18.734686 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Dec 20 05:45:18.737622 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Dec 20 05:45:18.737879 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Dec 20 05:45:18.738232 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Dec 20 05:45:18.744131 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Dec 20 05:45:18.767788 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Dec 20 05:45:18.768257 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.768563 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=102336) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Dec 20 05:45:18.768934 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.770319 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=102336) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Dec 20 05:45:18.770602 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Dec 20 05:45:18.770850 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Dec 20 05:45:18.774121 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.774403 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:18.839880 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Dec 20 05:45:18.840120 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Dec 20 05:45:18.840359 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Dec 20 05:45:18.840747 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Dec 20 05:45:18.862447 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_db.sqlalchemy.engines [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 20 05:45:19.293064 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Initializing driver for type 'gre' Dec 20 05:45:19.293750 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] gre ID ranges: [(1, 1000)] Dec 20 05:45:19.350547 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Initializing driver for type 'local' Dec 20 05:45:19.350876 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Initializing driver for type 'vlan' Dec 20 05:45:19.364040 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] VlanTypeDriver initialization complete Dec 20 05:45:19.364367 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Initializing driver for type 'vxlan' Dec 20 05:45:19.364857 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] vxlan ID ranges: [(1, 1000)] Dec 20 05:45:19.415308 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Initializing extension driver 'port_security' Dec 20 05:45:19.415695 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.extensions.port_security [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] PortSecurityExtensionDriver initialization complete Dec 20 05:45:19.416030 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Initializing mechanism driver 'openvswitch' Dec 20 05:45:19.416360 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Initializing mechanism driver 'hyperv' Dec 20 05:45:19.422970 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.plugins.ml2.plugin [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=102336) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:45:19.423843 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > port after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.424208 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > port after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.424557 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > port after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.425087 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=102336) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 20 05:45:19.425512 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > subnet after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.425860 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > subnet after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.426200 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > subnet after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.426594 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=102336) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 20 05:45:19.426994 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > network after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.427340 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > network after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.427711 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > network after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.428101 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=102336) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 20 05:45:19.428502 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > security_group after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.428850 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > security_group after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.429182 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > security_group after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.430067 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=102336) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 20 05:45:19.430474 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.430807 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.431146 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.431554 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=102336) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 20 05:45:19.431957 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > address_group after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.432295 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > address_group after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.432631 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > address_group after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.433013 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=102336) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 20 05:45:19.433385 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] ML2 OVO RPC backend initialized. {{(pid=102336) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Dec 20 05:45:19.434082 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router_interface after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.434432 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.434834 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > network before_response 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.435169 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > networks before_response 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.435504 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > port before_response 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.435861 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > ports before_response 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.436194 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > subnet before_response 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.436524 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > subnets before_response 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.436857 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > network after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.437186 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > network after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.437511 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > network after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.437836 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > port after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.438159 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > port after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.438480 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > port after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.438831 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > subnet after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.439155 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > subnet after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.439477 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > subnet after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.440066 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.plugin [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Modular L2 Plugin initialization complete Dec 20 05:45:19.440388 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading services supported by the core plugin {{(pid=102336) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Dec 20 05:45:19.440701 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.plugins.ml2.managers [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Got port-security extension from driver 'port_security' Dec 20 05:45:19.441159 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.extensions.vlantransparent [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Disabled vlantransparent extension. Dec 20 05:45:19.441658 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=102336) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Dec 20 05:45:19.441953 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading Plugin: router Dec 20 05:45:19.478603 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router_interface before_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.478989 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router after_create 55549900 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.479352 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router before_create 55549900 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.479744 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router_interface before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.480110 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.480461 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router after_delete 55549900 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.480812 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > floatingip after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.481274 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > floatingip after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.481626 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router after_create 55549900 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.481963 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router after_update 55549900 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.482302 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router after_update 55549900 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.482641 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.482991 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router after_update 55549900 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.483395 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router precommit_update 55549900 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.483780 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: port after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.484113 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: port after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.484443 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: subnet after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.484771 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.485110 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > port precommit_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.485446 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router precommit_create 55549900 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.485778 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: port before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.486112 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router precommit_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.486458 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router after_update 55549900 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.486788 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router precommit_delete 55549900 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.487127 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router precommit_create 55549900 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.487477 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router_interface after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.487837 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router precommit_update 55549900 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.488194 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > agent after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.488537 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > agent after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.488869 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > network after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.489737 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Tracking information for resource: router configured {{(pid=102336) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 20 05:45:19.490064 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Tracking information for resource: floatingip configured {{(pid=102336) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 20 05:45:19.495448 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.db.l3_agentschedulers_db [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Dec 20 05:45:19.496050 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: port after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.496405 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: port after_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.496750 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: port after_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.497092 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: port after_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.497861 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router before_create 55550100 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.498216 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router precommit_delete 55550100 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.498575 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router precommit_create 55550100 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.498925 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > router precommit_update 55550100 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.503594 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.services.provider_configuration [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service providers = [] {{(pid=102336) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Dec 20 05:45:19.503956 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.db.servicetype_db [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=102336) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Dec 20 05:45:19.506870 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.services.service_base [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=102336) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 20 05:45:19.507219 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.services.service_base [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=102336) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 20 05:45:19.507587 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.services.service_base [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=102336) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 20 05:45:19.509128 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.services.service_base [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=102336) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 20 05:45:19.509498 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.services.service_base [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Default provider is not specified for service type L3_ROUTER_NAT Dec 20 05:45:19.509873 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=102336) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 20 05:45:19.510189 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Dec 20 05:45:19.520825 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Successfully loaded METERING plugin. Description: METERING {{(pid=102336) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 20 05:45:19.521154 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading Plugin: auto_allocate Dec 20 05:45:19.526963 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: network precommit_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.527323 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: network precommit_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.527870 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=102336) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 20 05:45:19.528185 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading Plugin: tag Dec 20 05:45:19.535013 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=102336) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 20 05:45:19.535336 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading Plugin: timestamp Dec 20 05:45:19.539188 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=102336) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 20 05:45:19.539535 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading Plugin: network_ip_availability Dec 20 05:45:19.545249 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.545448 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.545882 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.546870 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=102336) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 20 05:45:19.547345 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading Plugin: flavors Dec 20 05:45:19.554098 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=102336) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 20 05:45:19.555048 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading Plugin: revisions Dec 20 05:45:19.560695 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=102336) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 20 05:45:19.561218 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_concurrency.lockutils [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.766s {{(pid=102336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 20 05:45:19.562391 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=102336) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Dec 20 05:45:19.562879 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Initializing extension manager. Dec 20 05:45:19.563599 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: __init__.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.563944 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: __pycache__ {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.564275 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.564603 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: address_group.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.565362 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.565928 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: address-group Dec 20 05:45:19.566246 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: address_scope.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.566948 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.567453 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: address-scope Dec 20 05:45:19.567793 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: admin_state_down_before_update.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.568710 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.569213 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: router-admin-state-down-before-update Dec 20 05:45:19.569535 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: agent.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.570273 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.571286 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: agent Dec 20 05:45:19.571704 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: agent_resources_synced.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.572528 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.573031 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: agent-resources-synced Dec 20 05:45:19.573347 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: allowedaddresspairs.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.575371 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.575915 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: allowed-address-pairs Dec 20 05:45:19.576237 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: auto_allocated_topology.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.577316 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.577829 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: auto-allocated-topology Dec 20 05:45:19.578152 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: availability_zone.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.578839 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.579339 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: availability_zone Dec 20 05:45:19.579697 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: availability_zone_filter.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.580614 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.581114 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: availability_zone_filter Dec 20 05:45:19.581430 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: data_plane_status.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.582326 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.582826 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension data-plane-status not supported by any of loaded plugins Dec 20 05:45:19.583141 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: default_subnetpools.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.584072 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.584611 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: default-subnetpools Dec 20 05:45:19.584922 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: dhcpagentscheduler.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.585731 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.586262 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: dhcp_agent_scheduler Dec 20 05:45:19.586583 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: dns.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.587500 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.588170 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension dns-integration not supported by any of loaded plugins Dec 20 05:45:19.588489 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: dns_domain_ports.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.589402 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.589907 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension dns-domain-ports not supported by any of loaded plugins Dec 20 05:45:19.590223 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.591133 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.591669 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Dec 20 05:45:19.591985 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: dvr.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.592639 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.593137 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: dvr Dec 20 05:45:19.593448 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: ecmp_routes.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.594346 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.594842 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension ecmp_routes not supported by any of loaded plugins Dec 20 05:45:19.595157 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: empty_string_filtering.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.596079 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.596584 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: empty-string-filtering Dec 20 05:45:19.596898 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.597797 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.598295 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Dec 20 05:45:19.598612 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.599552 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.600031 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Dec 20 05:45:19.600347 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: external_net.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.601243 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.601770 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: external-net Dec 20 05:45:19.602087 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: extra_dhcp_opt.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.602986 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.603490 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: extra_dhcp_opt Dec 20 05:45:19.603836 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: extraroute.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.604719 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.605220 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: extraroute Dec 20 05:45:19.605535 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: extraroute_atomic.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.608193 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.608725 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: extraroute-atomic Dec 20 05:45:19.609024 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: filter_validation.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.609691 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.610277 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: filter-validation Dec 20 05:45:19.610515 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: fip_pf_description.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.611424 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.611951 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Dec 20 05:45:19.612268 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: fip_port_details.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.613181 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.613680 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: fip-port-details Dec 20 05:45:19.613997 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: flavors.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.615241 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.615779 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: flavors Dec 20 05:45:19.616103 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.618571 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.619089 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Dec 20 05:45:19.619414 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: floatingip_pools.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.620136 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.620645 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: floatingip-pools Dec 20 05:45:19.620965 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: ip_allocation.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.621885 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.622386 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension ip_allocation not supported by any of loaded plugins Dec 20 05:45:19.622705 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: ip_substring_port_filtering.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.623640 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.624148 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: ip-substring-filtering Dec 20 05:45:19.624469 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: l2_adjacency.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.625388 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.625890 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension l2_adjacency not supported by any of loaded plugins Dec 20 05:45:19.626206 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: l3.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.627183 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.627729 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: router Dec 20 05:45:19.628050 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: l3_conntrack_helper.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.630289 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.630817 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension l3-conntrack-helper not supported by any of loaded plugins Dec 20 05:45:19.631142 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: l3_ext_gw_mode.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.632095 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.632607 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: ext-gw-mode Dec 20 05:45:19.633468 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: l3_ext_ha_mode.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.634398 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.634910 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: l3-ha Dec 20 05:45:19.635226 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: l3_flavors.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.636157 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.636671 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: l3-flavors Dec 20 05:45:19.636985 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.637882 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.638391 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: l3-port-ip-change-not-allowed Dec 20 05:45:19.638709 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: l3agentscheduler.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.639776 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.640283 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: l3_agent_scheduler Dec 20 05:45:19.640602 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: local_ip.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.642355 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.642875 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension local_ip not supported by any of loaded plugins Dec 20 05:45:19.643203 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: logging.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.644710 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.645221 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension logging not supported by any of loaded plugins Dec 20 05:45:19.645544 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: metering.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.646402 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.646980 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: metering Dec 20 05:45:19.647299 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.648428 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.648941 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: metering_source_and_destination_fields Dec 20 05:45:19.649259 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: multiprovidernet.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.650164 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.650666 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: multi-provider Dec 20 05:45:19.650984 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: netmtu.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.651923 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.652429 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: net-mtu Dec 20 05:45:19.652746 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: netmtu_writable.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.653648 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.654150 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: net-mtu-writable Dec 20 05:45:19.654465 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: network_availability_zone.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.655126 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.655658 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: network_availability_zone Dec 20 05:45:19.655980 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: network_ip_availability.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.657412 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.658149 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: network-ip-availability Dec 20 05:45:19.658472 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: network_segment_range.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.659228 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.659758 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension network-segment-range not supported by any of loaded plugins Dec 20 05:45:19.660075 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: pagination.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.661044 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.661367 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: pagination Dec 20 05:45:19.661681 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: port_device_profile.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.662575 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.663077 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: port-device-profile Dec 20 05:45:19.663389 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: port_mac_address_regenerate.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.664349 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.664847 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: port-mac-address-regenerate Dec 20 05:45:19.665162 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: port_numa_affinity_policy.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.666066 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.666569 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: port-numa-affinity-policy Dec 20 05:45:19.666886 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: port_resource_request.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.667827 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.668325 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension port-resource-request not supported by any of loaded plugins Dec 20 05:45:19.668639 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: port_resource_request_groups.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.669591 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.670088 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension port-resource-request-groups not supported by any of loaded plugins Dec 20 05:45:19.670405 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: portbindings.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.671315 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.671849 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: binding Dec 20 05:45:19.672167 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: portbindings_extended.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.673430 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.673938 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: binding-extended Dec 20 05:45:19.674258 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: portsecurity.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.675175 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.675710 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: port-security Dec 20 05:45:19.676029 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: project_id.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.676994 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.677314 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: project-id Dec 20 05:45:19.677627 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: providernet.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.678529 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.679034 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: provider Dec 20 05:45:19.679348 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: qos.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.683397 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.684018 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension qos not supported by any of loaded plugins Dec 20 05:45:19.684351 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: qos_bw_limit_direction.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.685584 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.686093 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Dec 20 05:45:19.686419 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.687322 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.687870 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Dec 20 05:45:19.688195 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: qos_default.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.689095 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.689600 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension qos-default not supported by any of loaded plugins Dec 20 05:45:19.689920 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: qos_fip.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.690566 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.691065 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension qos-fip not supported by any of loaded plugins Dec 20 05:45:19.691384 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: qos_fip_network_policy.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.692317 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="QoS floating IP network policy ID" alias="qos-fip-network-policy" description="Adds a the QoS network ID to the floating IP definition" updated="2021-11-15T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.692820 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension qos-fip-network-policy not supported by any of loaded plugins Dec 20 05:45:19.693137 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: qos_gateway_ip.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.694044 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.694548 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension qos-gateway-ip not supported by any of loaded plugins Dec 20 05:45:19.694865 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: qos_port_network_policy.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.696459 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.696965 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension qos-port-network-policy not supported by any of loaded plugins Dec 20 05:45:19.697284 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.698306 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.698810 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension qos-pps-minimum not supported by any of loaded plugins Dec 20 05:45:19.699126 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: qos_pps_rule.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.700593 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.701108 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension qos-pps not supported by any of loaded plugins Dec 20 05:45:19.701430 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: qos_rule_type_details.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.702333 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.702840 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension qos-rule-type-details not supported by any of loaded plugins Dec 20 05:45:19.703163 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: qos_rules_alias.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.704226 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.704738 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension qos-rules-alias not supported by any of loaded plugins Dec 20 05:45:19.705056 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: quota_check_limit.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.705957 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.706467 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: quota-check-limit Dec 20 05:45:19.706779 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: quotasv2.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.707737 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.708058 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: quotas Dec 20 05:45:19.708373 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: quotasv2_detail.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.711659 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.711991 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: quota_details Dec 20 05:45:19.712320 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: rbac.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.713367 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.713894 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: rbac-policies Dec 20 05:45:19.714219 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: rbac_address_group.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.715152 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.715698 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: rbac-address-group Dec 20 05:45:19.716022 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: rbac_address_scope.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.716937 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.717443 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: rbac-address-scope Dec 20 05:45:19.717760 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: rbac_security_groups.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.718663 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.719166 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: rbac-security-groups Dec 20 05:45:19.719484 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: rbac_subnetpool.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.720413 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.720916 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: rbac-subnetpool Dec 20 05:45:19.721232 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: revisionifmatch.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.722146 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.722648 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: revision-if-match Dec 20 05:45:19.722964 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: revisions.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.724109 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.724611 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: standard-attr-revisions Dec 20 05:45:19.724922 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: router_availability_zone.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.725585 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.726082 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: router_availability_zone Dec 20 05:45:19.726395 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: routerservicetype.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.727870 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.728369 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension router-service-type not supported by any of loaded plugins Dec 20 05:45:19.728681 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.729679 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.730186 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: security-groups-normalized-cidr Dec 20 05:45:19.730501 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: security_groups_port_filtering.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.731413 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.731941 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: port-security-groups-filtering Dec 20 05:45:19.732255 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: security_groups_remote_address_group.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.734549 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.735060 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: security-groups-remote-address-group Dec 20 05:45:19.735382 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: security_groups_shared_filtering.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.737031 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.737541 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: security-groups-shared-filtering Dec 20 05:45:19.737857 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.738447 dv-cinder-822278-1-iscsi neutron-server[102336]: WARNING neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Dec 20 05:45:19.740829 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: securitygroup.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.752904 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.753439 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: security-group Dec 20 05:45:19.753768 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: segment.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.754570 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.755075 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension segment not supported by any of loaded plugins Dec 20 05:45:19.755396 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.756428 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.756941 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Dec 20 05:45:19.757263 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: servicetype.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.758388 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.758907 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: service-type Dec 20 05:45:19.759231 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: sorting.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.760241 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.760573 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: sorting Dec 20 05:45:19.760893 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: standard_attr_segment.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.761805 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.762313 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension standard-attr-segment not supported by any of loaded plugins Dec 20 05:45:19.762632 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: standardattrdescription.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.763293 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.763830 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: standard-attr-description Dec 20 05:45:19.764148 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: stateful_security_group.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.765066 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.765580 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: stateful-security-group Dec 20 05:45:19.765898 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: stdattrs_common.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.766459 dv-cinder-822278-1-iscsi neutron-server[102336]: WARNING neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Dec 20 05:45:19.766772 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.767721 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.768231 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Dec 20 05:45:19.768546 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: subnet_onboard.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.769662 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.770169 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: subnet_onboard Dec 20 05:45:19.770488 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: subnet_segmentid_writable.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.771398 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.771937 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Dec 20 05:45:19.772251 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: subnet_service_types.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.773163 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.773698 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: subnet-service-types Dec 20 05:45:19.774018 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: subnetallocation.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.775086 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.775624 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: subnet_allocation Dec 20 05:45:19.775947 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.776603 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.777105 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: subnetpool-prefix-ops Dec 20 05:45:19.777414 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.778333 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.778833 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Dec 20 05:45:19.779150 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: tagging.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.780253 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.780760 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: standard-attr-tag Dec 20 05:45:19.781080 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: timestamp.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.782260 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.782763 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loaded extension: standard-attr-timestamp Dec 20 05:45:19.783079 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: trunk.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.784161 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.784676 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension trunk not supported by any of loaded plugins Dec 20 05:45:19.784993 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: trunk_details.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.785907 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.786418 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension trunk-details not supported by any of loaded plugins Dec 20 05:45:19.786729 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: uplink_status_propagation.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.787669 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.788175 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension uplink-status-propagation not supported by any of loaded plugins Dec 20 05:45:19.788488 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Loading extension file: vlantransparent.py {{(pid=102336) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 20 05:45:19.789678 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=102336) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 20 05:45:19.790190 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extension vlan-transparent not supported by any of loaded plugins Dec 20 05:45:19.792790 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:network Dec 20 05:45:19.793322 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:subnet Dec 20 05:45:19.793712 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:subnetpool Dec 20 05:45:19.794095 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:port Dec 20 05:45:19.795397 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.v2.resource_helper [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102336) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 20 05:45:19.795835 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.v2.resource_helper [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service FLAVORS assigned prefix: {{(pid=102336) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 20 05:45:19.796470 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.v2.resource_helper [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102336) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 20 05:45:19.796884 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.v2.resource_helper [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102336) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 20 05:45:19.797217 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:router Dec 20 05:45:19.797635 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:floatingip Dec 20 05:45:19.798129 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.v2.resource_helper [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service METERING assigned prefix: /metering {{(pid=102336) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 20 05:45:19.799589 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.799954 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.800297 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102336) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:45:19.801293 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of CountableResource for resource:rbac_policy Dec 20 05:45:19.801729 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:security_group Dec 20 05:45:19.802148 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:security_group_rule Dec 20 05:45:19.802757 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.v2.resource_helper [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service CORE assigned prefix: {{(pid=102336) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 20 05:45:19.803086 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:subnetpool Dec 20 05:45:19.803420 dv-cinder-822278-1-iscsi neutron-server[102336]: WARNING neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] subnetpool is already registered Dec 20 05:45:19.803881 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.v2.resource_helper [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service CORE assigned prefix: {{(pid=102336) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 20 05:45:19.804204 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:subnetpool Dec 20 05:45:19.804526 dv-cinder-822278-1-iscsi neutron-server[102336]: WARNING neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] subnetpool is already registered Dec 20 05:45:19.807345 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.v2.resource_helper [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102336) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 20 05:45:19.807797 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.v2.resource_helper [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service FLAVORS assigned prefix: {{(pid=102336) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 20 05:45:19.808377 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.v2.resource_helper [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102336) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 20 05:45:19.808791 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.v2.resource_helper [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102336) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 20 05:45:19.809119 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:router Dec 20 05:45:19.809449 dv-cinder-822278-1-iscsi neutron-server[102336]: WARNING neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] router is already registered Dec 20 05:45:19.809851 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:floatingip Dec 20 05:45:19.810176 dv-cinder-822278-1-iscsi neutron-server[102336]: WARNING neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] floatingip is already registered Dec 20 05:45:19.810625 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.v2.resource_helper [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service METERING assigned prefix: /metering {{(pid=102336) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 20 05:45:19.811284 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of CountableResource for resource:rbac_policy Dec 20 05:45:19.811628 dv-cinder-822278-1-iscsi neutron-server[102336]: WARNING neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] rbac_policy is already registered Dec 20 05:45:19.812035 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:security_group Dec 20 05:45:19.812363 dv-cinder-822278-1-iscsi neutron-server[102336]: WARNING neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] security_group is already registered Dec 20 05:45:19.812759 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:security_group_rule Dec 20 05:45:19.813081 dv-cinder-822278-1-iscsi neutron-server[102336]: WARNING neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] security_group_rule is already registered Dec 20 05:45:19.813702 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.v2.resource_helper [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service CORE assigned prefix: {{(pid=102336) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 20 05:45:19.814024 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:subnetpool Dec 20 05:45:19.814355 dv-cinder-822278-1-iscsi neutron-server[102336]: WARNING neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] subnetpool is already registered Dec 20 05:45:19.814771 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.v2.resource_helper [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Service CORE assigned prefix: {{(pid=102336) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 20 05:45:19.815090 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Creating instance of TrackedResource for resource:subnetpool Dec 20 05:45:19.815410 dv-cinder-822278-1-iscsi neutron-server[102336]: WARNING neutron.quota.resource_registry [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] subnetpool is already registered Dec 20 05:45:19.815908 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: extensions {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.817416 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: address-groups {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.818899 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: address-scopes {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.820250 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: agents {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.821410 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: auto-allocated-topology {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.822659 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: availability_zones {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.823911 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: dhcp-networks {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.825695 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: dhcp-agents {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.827151 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: routers {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.829383 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: flavors {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.830554 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: service_profiles {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.831804 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: next_providers {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.833227 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: service_profiles {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.835835 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: floatingip-pools {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.837086 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: routers {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.839197 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: floatingips {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.840495 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: l3-routers {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.841882 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: l3-agents {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.843288 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: metering-labels {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.844666 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: metering-label-rules {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.845968 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: network-ip-availabilities {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.847220 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: bindings {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.848889 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: quotas {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.850474 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: quotas {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.852567 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: rbac-policies {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.853845 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: security-groups {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.855061 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: security-group-rules {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.856330 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: service-providers {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.857548 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: subnetpools {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.858978 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: subnetpools {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.860465 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: tags {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.862138 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: tags {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.863962 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: tags {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.865809 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: tags {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.868218 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: tags {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.870060 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: tags {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.871767 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: tags {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.873687 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: tags {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.875444 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: tags {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.877325 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron.api.extensions [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Extended resource: tags {{(pid=102336) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 20 05:45:19.883327 dv-cinder-822278-1-iscsi neutron-server[102336]: WARNING keystonemiddleware.auth_token [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 20 05:45:19.888054 dv-cinder-822278-1-iscsi neutron-server[102336]: WARNING keystonemiddleware.auth_token [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 20 05:45:19.896571 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_concurrency.lockutils [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Acquired lock "singleton_lock" {{(pid=102336) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 20 05:45:19.897036 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_concurrency.lockutils [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Releasing lock "singleton_lock" {{(pid=102336) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 20 05:45:19.897677 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO oslo_service.service [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Starting 2 workers Dec 20 05:45:19.903241 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Started child 102445 {{(pid=102336) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 20 05:45:19.907824 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Started child 102446 {{(pid=102336) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 20 05:45:19.908761 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:19.909479 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO neutron.service [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Neutron service started, listening on 0.0.0.0:9696 Dec 20 05:45:19.910057 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Publish callbacks [] for process, before_spawn {{(pid=102336) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:19.910221 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [-] (102445) wsgi starting up on http://0.0.0.0:9696 Dec 20 05:45:19.912425 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO oslo_service.service [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Starting 1 workers Dec 20 05:45:19.912585 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:19.914493 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [-] (102446) wsgi starting up on http://0.0.0.0:9696 Dec 20 05:45:19.918135 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Started child 102447 {{(pid=102336) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 20 05:45:19.918676 dv-cinder-822278-1-iscsi neutron-server[102336]: INFO oslo_service.service [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Starting 1 workers Dec 20 05:45:19.921875 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.service [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] calling RpcWorker wait() {{(pid=102447) _wait /opt/stack/neutron/neutron/service.py:128}} Dec 20 05:45:19.922407 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.service [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] returning from RpcWorker wait() {{(pid=102447) _wait /opt/stack/neutron/neutron/service.py:135}} Dec 20 05:45:19.923149 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Started child 102448 {{(pid=102336) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 20 05:45:19.923807 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:19.923997 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG neutron_lib.callbacks.manager [None req-eb869b86-0a1e-4910-ba78-35935374b0ba None None] Publish callbacks [] for process, after_spawn {{(pid=102336) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:19.924383 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:45:19.925883 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102336) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 20 05:45:19.926090 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 20 05:45:19.926273 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 20 05:45:19.926488 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 20 05:45:19.926811 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 20 05:45:19.926990 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 20 05:45:19.927495 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.927787 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.928039 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:19.928490 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.928490 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.928643 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.929117 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.929220 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:45:19.929372 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.929719 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.930473 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.930729 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.930899 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.931075 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.931306 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.931553 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.931855 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.932130 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.932366 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.932619 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.932788 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.933048 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.933319 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.933584 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.933861 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] debug = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.934105 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.934601 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.934830 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.935068 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.935297 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.935597 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.935846 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.936111 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.936339 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.936583 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.936829 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.937083 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.937319 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.937528 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.937762 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.937971 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.938227 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.938445 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.938897 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] host = dv-cinder-822278-1-iscsi {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.939126 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.939378 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.939619 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.939867 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.940106 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.940318 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.940564 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.940820 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.941059 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.941281 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.941519 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.941770 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.941974 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.942211 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_file = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.942369 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_options = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.942607 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.942871 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.943127 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.943324 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.943489 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.943673 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.943942 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.944101 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.944346 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.944555 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.944763 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.944989 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.945262 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.945503 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.945778 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.946006 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.946257 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.946466 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.946717 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.946939 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.947177 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.947401 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.947657 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.947897 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.948107 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.948336 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.948575 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.948862 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.949014 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.949216 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.949445 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.949684 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.949898 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.950382 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.950650 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.950893 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.951114 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.951345 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.951645 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.951851 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.952091 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.952337 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.952546 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.952787 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.952996 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.953235 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.953471 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] use_json = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.953683 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.953938 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.954159 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.954374 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.954589 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.954797 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.955004 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.955248 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:19.955702 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.955977 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.956291 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.956532 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.956783 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.957023 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.957253 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.957489 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.957738 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.957982 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.958309 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.958561 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.958969 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.959204 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.959500 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.959833 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.960073 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.960342 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.960577 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.960847 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.961086 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.961306 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.961661 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.961982 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.962129 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.962341 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.962563 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.962863 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.963303 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.963646 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.963876 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.964053 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.46/identity {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.964272 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.964627 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.964840 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.964976 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.965248 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.965802 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.966074 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.966487 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.966636 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.966780 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.966983 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.967209 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.967422 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.967674 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.967930 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.968208 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.968442 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.968634 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.968804 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.969094 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.969271 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.969490 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.969788 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.970019 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.970302 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.970515 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.970749 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.970933 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.971152 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.971657 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.971657 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.973857 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.973857 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.973857 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.973857 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.973857 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.973857 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.973857 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.973857 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.973857 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.974441 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.974441 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.974441 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.974441 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.974817 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.974817 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.974967 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.975131 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.975363 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.975642 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.977704 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.977704 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.977704 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.977704 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.977704 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.977704 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.977704 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.977704 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.980036 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.980036 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.980036 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.980036 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.980036 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.980036 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.980036 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.980036 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.980742 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.980742 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.980742 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.980742 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.980742 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.982310 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.982310 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.982310 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.982310 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.982310 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.982310 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.982310 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.982988 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.982988 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.982988 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.985873 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.985873 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.985873 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.985873 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.985873 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.985873 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.985873 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.985873 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.989281 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.989281 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.989281 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.989281 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.989281 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.989281 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.989281 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.989281 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990180 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990180 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990180 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990180 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990180 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990180 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990180 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990180 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990812 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990812 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990812 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990812 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990812 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990812 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990812 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.990812 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.991680 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.991680 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.991680 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.991680 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.991680 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.46/identity {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.992801 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.992801 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.992801 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.993151 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.993287 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.993401 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.996750 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.996750 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.996750 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.996750 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.996750 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.996750 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.996750 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.996750 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.997775 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.997775 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.997775 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.997775 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.997775 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.997775 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.997775 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.997775 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.998719 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.998719 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.998719 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.998719 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.998719 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.998719 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.998719 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.998719 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.999975 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.999975 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.999975 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.999975 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.999975 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:19.999975 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.000738 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.000738 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.000738 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.000738 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.001586 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.001586 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.001586 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.002107 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.002107 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.002415 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.002415 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.002701 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.002838 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.003069 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.003272 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.003505 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.003741 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.003954 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.004189 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.004425 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.004674 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.004885 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.005110 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.005324 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.005536 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.005744 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.006031 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.006280 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.006521 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.006769 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.006980 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.007206 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.007485 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.007729 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.007947 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.008167 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.008378 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.008584 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.008805 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.009010 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.009217 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.009433 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.009645 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.009882 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.010132 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.010338 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.010545 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.010784 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.011015 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.011222 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.011558 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.011767 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.012126 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.012519 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.012916 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.013272 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.013646 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.013869 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.014080 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.014308 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.015783 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.015783 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.015783 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.015783 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.015783 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.015783 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.016409 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.016409 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.016409 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.016739 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.016950 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.017184 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.017397 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.017648 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.017864 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.018140 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.018460 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.018670 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.018925 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.019148 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.019433 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.019734 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:400:449'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.019989 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.020446 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.020556 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.020801 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.021068 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.021339 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.021544 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.021785 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.022025 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.022236 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.022465 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.022695 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.022909 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.023141 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.023402 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.023654 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.023886 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.024109 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.024322 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.024571 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.024799 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.025032 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.025256 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.025405 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 20 05:45:20.025927 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102336) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 20 05:45:20.026081 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 20 05:45:20.026214 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 20 05:45:20.026373 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 20 05:45:20.026544 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 20 05:45:20.026708 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 20 05:45:20.026885 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.027026 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.027184 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.027386 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.027590 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.027722 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.027809 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.027966 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.028118 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.028272 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.028428 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.028583 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.028743 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.028925 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.029050 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.029205 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.029359 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.029514 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.029673 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.029829 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.029983 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.030141 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.030331 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] debug = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.030485 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.030644 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.030833 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.030975 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.031112 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.031250 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.031386 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.031560 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.031721 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.031860 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.031997 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.032134 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.032270 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.032407 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.032559 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.032696 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.032832 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.033046 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.033187 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] host = dv-cinder-822278-1-iscsi {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.033323 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.033459 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.033595 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.033731 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.033868 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.034003 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.034138 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.034283 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.034432 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.034570 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.034706 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.034843 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.034980 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.035115 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_file = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.035251 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_options = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.035395 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.035564 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.035709 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.035847 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.035986 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.036124 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.036273 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.036411 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.036548 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.036695 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.036835 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.036971 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.037107 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.037253 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.037390 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.037526 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.037670 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.037811 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.037968 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.038107 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.038243 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.038858 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.038858 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.038858 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.038858 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.039956 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.039956 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.039956 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.039956 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.040509 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.040509 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.040509 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.040509 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.042853 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.042853 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.042853 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.042853 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.042853 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.042853 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.042853 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.042853 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.043565 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.043565 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.043565 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.043565 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.043565 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.043565 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] use_json = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.043565 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.043565 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.043565 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.044246 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.044246 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.044246 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.044246 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.044246 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 20 05:45:20.044246 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.044246 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.044246 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.045038 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.045038 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.045038 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.045038 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.045038 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.045446 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.045446 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.045446 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.045678 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.045678 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.045825 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.045971 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.046129 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.046286 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.046446 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.046603 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.046762 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.046918 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.047079 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.047243 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.047400 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.047577 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.047737 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.047893 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.048058 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.048214 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.048387 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.048543 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.048702 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.46/identity {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.048860 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.049017 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.049175 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.049333 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.049491 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.049650 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.049809 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.049967 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.050124 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.050282 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.050441 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.050599 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.050757 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.050914 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.051072 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.051229 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.051386 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.051570 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.051731 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.051888 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.052048 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.052326 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.052326 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.052553 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.052675 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.052890 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.053081 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.053081 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.053313 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.053486 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.053683 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.053683 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.054354 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.054354 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.054354 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.054354 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.055308 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.055308 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.055308 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.055987 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.055987 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.055987 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.055987 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.055987 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.056551 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.056551 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.056551 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.056551 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.056959 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.056959 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.057197 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.057197 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.057347 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.057457 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.057619 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.057776 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.057932 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.058090 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.058249 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.059531 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.059531 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.059531 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.059531 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.059531 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.059531 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.059531 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.059531 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.060046 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.060046 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.060167 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.060363 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.060521 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.060723 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.060858 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.061026 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.061194 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.061362 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.061528 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.061694 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.061878 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.062026 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.062189 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.062377 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.062543 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.062706 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.062869 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.063044 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.063205 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.063369 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.063549 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.063725 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.063883 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.064047 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.064213 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.064375 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.064818 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.064818 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.064818 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.065502 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.065502 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.065502 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.065502 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.066109 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.066109 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.066109 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.066109 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.066489 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.066489 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.066648 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.066727 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.066858 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.067072 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.067262 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.067438 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.067585 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.067711 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.067833 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.068019 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.46/identity {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.068185 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.068311 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.068479 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.068604 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.068770 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.068933 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.069094 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.069256 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.069418 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.069579 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.069739 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.069900 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.070067 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.070248 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.070408 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.070569 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.070732 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.070891 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.071162 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.071280 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.071362 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.071505 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.071754 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.071917 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.072078 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.072241 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.072402 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.072565 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.072733 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.072877 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.073040 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.073202 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.073365 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.073527 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.073690 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.073852 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.074032 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.074165 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.074323 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.074480 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.074637 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.074888 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.075307 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.075488 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.075675 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.075837 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.075998 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.076160 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.076321 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.076483 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.076645 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.076807 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.076969 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.077129 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.077294 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.077458 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.077570 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:45:20.077662 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.077772 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.077933 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.078094 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.078255 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.078416 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.078591 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.078759 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.078921 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.079082 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.079242 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.079403 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.079602 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.079760 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.079906 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.080049 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.080264 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.080398 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.080515 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.080671 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.080831 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.080991 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.081143 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.081306 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.081520 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.081656 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.081775 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.081990 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.082127 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.082242 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.082439 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.082582 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.082697 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.082910 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.083104 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.083294 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.083294 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.083685 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.083685 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.084041 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.084041 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.084395 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.084395 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.084771 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.084771 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.085125 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.085125 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.085477 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.085477 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.086373 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.086373 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.086766 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.086766 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.086766 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.087321 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.087321 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.087321 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.087904 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.087904 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.087904 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.087904 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.088623 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:400:449'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.088623 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.088623 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.088623 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.089063 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.089063 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.089063 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.089381 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.089381 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.089756 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.089756 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.089756 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.090052 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.090052 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.090246 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.090845 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.090845 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.090845 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.090845 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.091340 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.091340 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.091340 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.091340 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.091976 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 20 05:45:20.091976 dv-cinder-822278-1-iscsi neutron-server[102336]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 20 05:45:20.095448 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39102) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:45:20.104878 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [-] 10.222.0.46 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0070655 Dec 20 05:45:31.769586 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e4890e9-d206-4e28-bd9a-6b3185012549 None None] get_active_networks_info from dv-cinder-822278-1-iscsi {{(pid=102447) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 20 05:45:31.908771 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e4890e9-d206-4e28-bd9a-6b3185012549 None None] No non-hosted networks {{(pid=102447) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Dec 20 05:45:31.921516 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.agentschedulers_db [None req-3e4890e9-d206-4e28-bd9a-6b3185012549 None None] DHCP Agent not found on host dv-cinder-822278-1-iscsi {{(pid=102447) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Dec 20 05:45:31.982705 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-e5901f70-d656-4186-aaaa-9dffe989cf9a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1697183'] for agent, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:34.115354 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-84e5ef40-193a-4cb4-949a-3ff1b4163bc8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1697183'] for agent, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:34.170426 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-5c8a9d9b-891d-4847-855e-175b7573ed4f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:34.979107 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1697183'] for agent, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:36.431286 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1697183'] for agent, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:37.542382 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1697183'] for agent, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:37.544896 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:37.544896 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:37.544896 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:37.544896 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:37.546071 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:37.546502 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:37.547035 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:37.547269 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:37.547718 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:37.548105 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:37.548656 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:37.550182 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:37.550785 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:37.551404 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-822278-1-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:45:37.558852 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-822278-1-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:45:37.983333 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39196) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:45:38.521599 dv-cinder-822278-1-iscsi neutron-server[102446]: WARNING oslo_policy.policy [None req-c8b554eb-6a95-43c6-ae6e-50829a3bb0a6 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 20 05:45:38.522184 dv-cinder-822278-1-iscsi neutron-server[102446]: WARNING oslo_policy.policy [None req-c8b554eb-6a95-43c6-ae6e-50829a3bb0a6 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 20 05:45:38.746051 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [None req-c8b554eb-6a95-43c6-ae6e-50829a3bb0a6 admin admin] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102446) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 05:45:38.759540 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-c8b554eb-6a95-43c6-ae6e-50829a3bb0a6 admin admin] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7627995 Dec 20 05:45:39.889861 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.db.l3_hamode_db [None req-0ae123f8-f1f4-4047-b434-7591a72b1cae None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Dec 20 05:45:39.966450 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ae123f8-f1f4-4047-b434-7591a72b1cae None None] Routers set() bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:45:39.966813 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ae123f8-f1f4-4047-b434-7591a72b1cae None None] Router IDs set() for agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 20 05:45:41.456497 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39212) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:45:41.771422 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-533c6d40-17a6-489d-96bd-a8006776f5ec admin admin] Request body: {'subnetpool': {'shared': True, 'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26, 'name': 'shared-default-subnetpool-v4', 'is_default': True}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:45:41.867707 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.policy [None req-533c6d40-17a6-489d-96bd-a8006776f5ec admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102446) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 20 05:45:41.912797 dv-cinder-822278-1-iscsi neutron-server[102446]: WARNING oslo_policy.policy [None req-533c6d40-17a6-489d-96bd-a8006776f5ec admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 20 05:45:41.913716 dv-cinder-822278-1-iscsi neutron-server[102446]: WARNING oslo_policy.policy [None req-533c6d40-17a6-489d-96bd-a8006776f5ec admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 20 05:45:41.922327 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.quota [None req-533c6d40-17a6-489d-96bd-a8006776f5ec admin admin] Loaded quota_driver: . Dec 20 05:45:42.013642 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-533c6d40-17a6-489d-96bd-a8006776f5ec admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8746764269246', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8746764267603', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8746764254919', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8746764252152', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8746763904273', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8746763896297', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-594666', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-603363', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1597692', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-2049368'] for rbac-policy, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:42.079835 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-533c6d40-17a6-489d-96bd-a8006776f5ec admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:42.081048 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-533c6d40-17a6-489d-96bd-a8006776f5ec admin admin] 10.222.0.46 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6235697 Dec 20 05:45:44.894875 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39224) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:45:45.191786 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Request body: {'network': {'project_id': 'f5349c1409984e8a89584df12177526e', 'name': 'private', 'tenant_id': 'f5349c1409984e8a89584df12177526e', 'admin_state_up': True}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:45:45.221872 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Made reservation on behalf of f5349c1409984e8a89584df12177526e for: {'network': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:45:45.224806 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:45.242961 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:45.352408 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:45.356036 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:45.379882 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] vlan segment allocate from pool success with {'vlan_id': 413, 'physical_network': 'physnet1'} {{(pid=102446) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:45:45.405764 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8746767306114', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:45.406373 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Unsubscribe: segment precommit_create {{(pid=102446) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 20 05:45:45.406881 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.segments_db [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Added segment b0cca571-baf9-400a-a1ed-b28c3c2cd814 of type vlan for network 4fc15cd7-f679-42bc-bda7-c6ea17902649 Dec 20 05:45:45.413595 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=064c1fa0-6293-4f5b-9fb8-70de49942a2e,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:45:45.454098 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:45.454462 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:45.454804 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:45.455137 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:45.455464 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:45.455813 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:45.456153 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:45.456479 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:45.456798 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:45.457131 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:45.457455 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:45.457772 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:45.458086 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Tracked resource versions report: Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: pushed versions: Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: { 'AddressGroup': {'1.2'}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'ConntrackHelper': {'1.0'}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'LocalIPAssociation': {'1.0'}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Log': {'1.0'}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Network': {'1.1'}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Port': {'1.7'}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'PortForwarding': {'1.2'}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'QosPolicy': {'1.10'}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'SecurityGroup': {'1.5'}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'SecurityGroupRule': {'1.2'}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'SubPort': {'1.0'}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Subnet': {'1.1'}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Trunk': {'1.1'}} Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: consumer versions: Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: { DHCP agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: L3 agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: Metadata agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: Metering agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: Open vSwitch agent@dv-cinder-822278-1-iscsi: { 'AddressGroup': '1.2', Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'ConntrackHelper': '1.0', Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'LocalIPAssociation': '1.0', Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Log': '1.0', Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Network': '1.1', Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Port': '1.7', Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'PortForwarding': '1.2', Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'QosPolicy': '1.10', Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'SecurityGroup': '1.5', Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'SecurityGroupRule': '1.2', Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'SubPort': '1.0', Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Subnet': '1.1', Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Trunk': '1.1'}} Dec 20 05:45:45.459459 dv-cinder-822278-1-iscsi neutron-server[102446]: {{(pid=102446) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 20 05:45:45.540166 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:45.586007 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:45.587060 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:45:45.587805 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:45.647667 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.7511907 Dec 20 05:45:45.686709 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c07172b-fdd2-4e6b-87f9-66968d21cb91 admin admin] Pushing event updated for resources: {'Network': ['ID=4fc15cd7-f679-42bc-bda7-c6ea17902649,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:45:45.698471 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network 4fc15cd7-f679-42bc-bda7-c6ea17902649 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:45:48.535979 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 39238) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:45:49.041546 dv-cinder-822278-1-iscsi neutron-server[102445]: WARNING oslo_policy.policy [None req-0fd0247d-859d-4b7c-a80f-bcf29cc975aa admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 20 05:45:49.042113 dv-cinder-822278-1-iscsi neutron-server[102445]: WARNING oslo_policy.policy [None req-0fd0247d-859d-4b7c-a80f-bcf29cc975aa admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 20 05:45:49.487418 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.policy [None req-0fd0247d-859d-4b7c-a80f-bcf29cc975aa admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102445) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 20 05:45:49.532589 dv-cinder-822278-1-iscsi neutron-server[102445]: WARNING oslo_policy.policy [None req-0fd0247d-859d-4b7c-a80f-bcf29cc975aa admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 20 05:45:49.532963 dv-cinder-822278-1-iscsi neutron-server[102445]: WARNING oslo_policy.policy [None req-0fd0247d-859d-4b7c-a80f-bcf29cc975aa admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 20 05:45:49.542550 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0fd0247d-859d-4b7c-a80f-bcf29cc975aa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:45:49.544509 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-0fd0247d-859d-4b7c-a80f-bcf29cc975aa admin admin] 10.222.0.46 "GET /v2.0/networks/4fc15cd7-f679-42bc-bda7-c6ea17902649 HTTP/1.1" status: 200 len: 825 time: 1.0064452 Dec 20 05:45:49.584296 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-5499c043-837c-49a3-9e1c-830fb5ef5ced admin admin] 10.222.0.46 "GET /v2.0/subnetpools/9be4beba-d1f4-4452-8cfe-cb772cef4248 HTTP/1.1" status: 200 len: 734 time: 0.0335400 Dec 20 05:45:49.593727 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Request body: {'subnet': {'tenant_id': 'f5349c1409984e8a89584df12177526e', 'gateway_ip': '172.20.0.1', 'name': 'private-subnet', 'subnetpool_id': '9be4beba-d1f4-4452-8cfe-cb772cef4248', 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649', 'ip_version': 4}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:45:49.595322 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.quota [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Loaded quota_driver: . Dec 20 05:45:49.641035 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Made reservation on behalf of f5349c1409984e8a89584df12177526e for: {'subnet': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:45:49.643866 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Publish callbacks [] for subnet, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:49.936642 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for subnet, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:50.005903 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Checking segment: {'id': 'b0cca571-baf9-400a-a1ed-b28c3c2cd814', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:45:50.006314 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Network hostable DHCP agents. Network: 4fc15cd7-f679-42bc-bda7-c6ea17902649, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:45:50.015818 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Pushing event updated for resources: {'Subnet': ['ID=bcf0d14b-8550-49a8-8d1e-9257c9132881,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:45:50.029012 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:50.029376 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:50.029717 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:50.030042 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:50.030366 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:50.030682 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:50.031013 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:50.031374 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:50.031676 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:50.032109 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:50.032448 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:50.032766 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:50.033075 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Tracked resource versions report: Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: pushed versions: Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: { 'AddressGroup': {'1.2'}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'ConntrackHelper': {'1.0'}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'LocalIPAssociation': {'1.0'}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Log': {'1.0'}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Network': {'1.1'}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Port': {'1.7'}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'PortForwarding': {'1.2'}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'QosPolicy': {'1.10'}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'SecurityGroup': {'1.5'}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'SecurityGroupRule': {'1.2'}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'SubPort': {'1.0'}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Subnet': {'1.1'}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Trunk': {'1.1'}} Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: consumer versions: Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: { DHCP agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: L3 agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: Metadata agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: Metering agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: Open vSwitch agent@dv-cinder-822278-1-iscsi: { 'AddressGroup': '1.2', Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'ConntrackHelper': '1.0', Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'LocalIPAssociation': '1.0', Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Log': '1.0', Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Network': '1.1', Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Port': '1.7', Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'PortForwarding': '1.2', Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'QosPolicy': '1.10', Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'SecurityGroup': '1.5', Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'SecurityGroupRule': '1.2', Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'SubPort': '1.0', Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Subnet': '1.1', Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Trunk': '1.1'}} Dec 20 05:45:50.034404 dv-cinder-822278-1-iscsi neutron-server[102445]: {{(pid=102445) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 20 05:45:50.066522 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Network 4fc15cd7-f679-42bc-bda7-c6ea17902649 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:45:50.079343 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, 4fc15cd7-f679-42bc-bda7-c6ea17902649) {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:45:50.085752 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:45:50.086540 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:50.090113 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-510b0ebe-f9b7-4c7e-b633-30c1e6c56761 None None] Network 4fc15cd7-f679-42bc-bda7-c6ea17902649 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:45:50.109975 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-973d2ed3-ae89-44e8-a687-831243a9aa0a admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.5196850 Dec 20 05:45:50.369470 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf82c7edd-7168-52b9-b9ff-dee431eec71c-4fc15cd7-f679-42bc-bda7-c6ea17902649', 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649', 'project_id': 'f5349c1409984e8a89584df12177526e', 'fixed_ips': [{'subnet_id': 'bcf0d14b-8550-49a8-8d1e-9257c9132881'}]}} from dv-cinder-822278-1-iscsi. {{(pid=102447) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 20 05:45:50.370827 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:50.696052 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.db_base_plugin_common [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Allocated IP 172.20.0.2 (4fc15cd7-f679-42bc-bda7-c6ea17902649/bcf0d14b-8550-49a8-8d1e-9257c9132881/6e3a6dee-f72f-4045-b370-472e3e63e568) {{(pid=102447) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:45:50.953681 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Publish callbacks [] for port, precommit_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:50.963569 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:51.042343 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Network 4fc15cd7-f679-42bc-bda7-c6ea17902649 is already hosted by enough agents. {{(pid=102447) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:45:51.047915 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.base_scheduler [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Resources bound (agent type, host, resource id): {{(pid=102447) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:45:51.057771 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Received port after_create {{(pid=102447) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:45:51.059902 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Pushing event updated for resources: {'Port': ['ID=6e3a6dee-f72f-4045-b370-472e3e63e568,revision_number=1']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:45:51.069940 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:51.070348 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:51.070706 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:51.071046 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:51.071380 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:51.071734 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:51.072058 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:51.072381 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:51.072704 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:51.073116 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:51.073372 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:51.073690 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:51.074011 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Tracked resource versions report: Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: pushed versions: Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: { 'AddressGroup': {'1.2'}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'ConntrackHelper': {'1.0'}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'LocalIPAssociation': {'1.0'}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Log': {'1.0'}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Network': {'1.1'}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Port': {'1.7'}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'PortForwarding': {'1.2'}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'QosPolicy': {'1.10'}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'SecurityGroup': {'1.5'}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'SecurityGroupRule': {'1.2'}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'SubPort': {'1.0'}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Subnet': {'1.1'}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Trunk': {'1.1'}} Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: consumer versions: Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: { DHCP agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: L3 agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: Metadata agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: Metering agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: Open vSwitch agent@dv-cinder-822278-1-iscsi: { 'AddressGroup': '1.2', Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'ConntrackHelper': '1.0', Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'LocalIPAssociation': '1.0', Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Log': '1.0', Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Network': '1.1', Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Port': '1.7', Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'PortForwarding': '1.2', Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'QosPolicy': '1.10', Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'SecurityGroup': '1.5', Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'SecurityGroupRule': '1.2', Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'SubPort': '1.0', Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Subnet': '1.1', Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Trunk': '1.1'}} Dec 20 05:45:51.075717 dv-cinder-822278-1-iscsi neutron-server[102447]: {{(pid=102447) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 20 05:45:51.150125 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Attempting to bind port 6e3a6dee-f72f-4045-b370-472e3e63e568 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:45:51.150806 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Attempting to bind port 6e3a6dee-f72f-4045-b370-472e3e63e568 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': 'b0cca571-baf9-400a-a1ed-b28c3c2cd814', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:45:51.150945 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Attempting to bind port 6e3a6dee-f72f-4045-b370-472e3e63e568 on network 4fc15cd7-f679-42bc-bda7-c6ea17902649 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:45:51.156133 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 45, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:45:51.156515 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Checking segment: {'id': 'b0cca571-baf9-400a-a1ed-b28c3c2cd814', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:45:51.157020 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:51.157409 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Bound using segment: {'id': 'b0cca571-baf9-400a-a1ed-b28c3c2cd814', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:45:51.157877 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Bound port: 6e3a6dee-f72f-4045-b370-472e3e63e568, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b0cca571-baf9-400a-a1ed-b28c3c2cd814', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:45:51.158393 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:51.224265 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] For port 6e3a6dee-f72f-4045-b370-472e3e63e568, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:45:51.229037 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] For port 6e3a6dee-f72f-4045-b370-472e3e63e568, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=6e3a6dee-f72f-4045-b370-472e3e63e568,segment=NetworkSegment(b0cca571-baf9-400a-a1ed-b28c3c2cd814),segment_id=b0cca571-baf9-400a-a1ed-b28c3c2cd814)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:45:51.233481 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:51.296757 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2fddff1-3ad1-490a-b184-014c91c6b030 None None] Pushing event updated for resources: {'Port': ['ID=6e3a6dee-f72f-4045-b370-472e3e63e568,revision_number=2']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:45:52.774246 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 39258) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:45:53.089767 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [None req-c980867e-66b7-4817-a8bc-2dd8cafaa9f4 admin admin] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 05:45:53.090777 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-c980867e-66b7-4817-a8bc-2dd8cafaa9f4 admin admin] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3155682 Dec 20 05:45:55.784189 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 39266) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:45:56.101120 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [None req-f4b36ddb-f584-4bac-b9e2-d78eab870dc5 admin admin] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 05:45:56.102122 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-f4b36ddb-f584-4bac-b9e2-d78eab870dc5 admin admin] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3169825 Dec 20 05:45:59.021212 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 39276) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:45:59.377868 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-931d612b-5fb5-455b-9a71-08d72fc618da admin admin] Request body: {'router': {'name': 'router1', 'admin_state_up': True, 'tenant_id': 'f5349c1409984e8a89584df12177526e'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:45:59.405655 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-931d612b-5fb5-455b-9a71-08d72fc618da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1698740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25959'] for router, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:59.407413 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-931d612b-5fb5-455b-9a71-08d72fc618da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1698340', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1703163', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1634740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25982'] for router, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:59.534156 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 6e3a6dee-f72f-4045-b370-472e3e63e568 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:45:59.551719 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-931d612b-5fb5-455b-9a71-08d72fc618da admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:59.562782 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-931d612b-5fb5-455b-9a71-08d72fc618da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1698355', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1703078'] for router, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:59.581918 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-931d612b-5fb5-455b-9a71-08d72fc618da admin admin] Publish callbacks [] for router, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:59.595014 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-931d612b-5fb5-455b-9a71-08d72fc618da admin admin] 10.222.0.46 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5600722 Dec 20 05:45:59.637339 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 6e3a6dee-f72f-4045-b370-472e3e63e568 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:45:59.637845 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:59.779431 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:59.820413 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port 6e3a6dee-f72f-4045-b370-472e3e63e568, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=6e3a6dee-f72f-4045-b370-472e3e63e568,segment=NetworkSegment(b0cca571-baf9-400a-a1ed-b28c3c2cd814),segment_id=b0cca571-baf9-400a-a1ed-b28c3c2cd814)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:45:59.826224 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:45:59.881893 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=6e3a6dee-f72f-4045-b370-472e3e63e568,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:46:00.539433 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9c81d51-44f3-48dd-a6cd-aff38c351034 None None] Network 4fc15cd7-f679-42bc-bda7-c6ea17902649 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:46:00.605892 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-37f90c89-1192-4785-89f9-76c622bd8c03 None None] Provisioning complete for port 6e3a6dee-f72f-4045-b370-472e3e63e568 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:46:00.606252 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-37f90c89-1192-4785-89f9-76c622bd8c03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:00.950528 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-a803635b-27c3-4bb0-b7af-cf0dd87ec7c4 None None] Provisioning complete for port 6e3a6dee-f72f-4045-b370-472e3e63e568 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:46:00.950890 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-a803635b-27c3-4bb0-b7af-cf0dd87ec7c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:01.485437 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 6e3a6dee-f72f-4045-b370-472e3e63e568 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:46:01.533273 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 6e3a6dee-f72f-4045-b370-472e3e63e568 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:46:01.533637 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:01.678901 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f1155b48-a0fa-4231-b1df-bac49bb330e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:02.287275 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39288) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:46:02.621516 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [None req-3adeee58-b41b-4b47-9f9d-4e6f08f51b45 admin admin] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102446) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 05:46:02.622507 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-3adeee58-b41b-4b47-9f9d-4e6f08f51b45 admin admin] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3342454 Dec 20 05:46:04.114552 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-18fea050-0095-46be-8b4a-ff568bca2baa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:04.923130 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:05.285975 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39306) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:46:05.420364 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Request body: {'network': {'admin_state_up': True, 'is_default': True, 'provider:network_type': 'flat', 'name': 'public', 'provider:physical_network': 'physnet1', 'router:external': True}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:46:05.443417 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Made reservation on behalf of bc3969fb5d1f430fa1fdc77337d8caaf for: {'network': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:46:05.445682 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:05.453880 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:05.530680 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:05.534472 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:05.554528 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Reserving flat network on physical network physnet1 {{(pid=102446) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Dec 20 05:46:05.572141 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ebc7a7fb-7cda-4737-8442-820759441996,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:46:05.578031 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:05.578355 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.segments_db [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Added segment 33a54534-46f6-4df5-9e55-51864e25c4b0 of type flat for network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 Dec 20 05:46:05.642525 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:05.678059 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:05.679160 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:46:05.679791 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:05.740413 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4533360 Dec 20 05:46:05.743658 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d3e5a44-f63e-41b1-8d20-4d64a3e95523 admin admin] Pushing event updated for resources: {'Network': ['ID=2e5c289b-6b36-4be8-98bd-7afaf0da3344,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:46:05.766723 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:46:06.370464 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:07.544080 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:08.313279 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39324) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:46:08.482458 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2709f76d-510c-4465-8b21-6786c5784af7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:46:08.483957 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-2709f76d-510c-4465-8b21-6786c5784af7 admin admin] 10.222.0.46 "GET /v2.0/subnets/bcf0d14b-8550-49a8-8d1e-9257c9132881 HTTP/1.1" status: 200 len: 849 time: 0.1696963 Dec 20 05:46:08.675920 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-ddfed988-4a1e-4398-a185-f139bf6e1d65 admin admin] 10.222.0.46 "GET /v2.0/routers/9bc11af8-d43c-4231-b1b8-449221a8e6d1 HTTP/1.1" status: 200 len: 704 time: 0.1849012 Dec 20 05:46:08.951653 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:09.264884 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Allocated IP 172.20.0.1 (4fc15cd7-f679-42bc-bda7-c6ea17902649/bcf0d14b-8550-49a8-8d1e-9257c9132881/9eda8635-539a-432d-895a-c89c930d86ba) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:46:09.533742 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:09.601931 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:09.683173 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Network 4fc15cd7-f679-42bc-bda7-c6ea17902649 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:46:09.688646 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:46:09.692252 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:46:09.692861 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1703675'] for router_interface, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:09.759007 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Pushing event updated for resources: {'Port': ['ID=9eda8635-539a-432d-895a-c89c930d86ba,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:46:09.907299 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-d3540390-b969-43cc-a389-767cf296b743 None None] Provisioning complete for port 9eda8635-539a-432d-895a-c89c930d86ba triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:46:09.907954 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-d3540390-b969-43cc-a389-767cf296b743 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:09.958713 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-d3540390-b969-43cc-a389-767cf296b743 None None] Port 9eda8635-539a-432d-895a-c89c930d86ba cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:46:09.968866 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:10.206287 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:10.211370 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:10.212189 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1617520', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1697131'] for router_interface, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:10.275314 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Pushing event updated for resources: {'Port': ['ID=9eda8635-539a-432d-895a-c89c930d86ba,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:46:10.359882 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Network 4fc15cd7-f679-42bc-bda7-c6ea17902649 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:46:10.361381 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:46:10.552793 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Router 9bc11af8-d43c-4231-b1b8-449221a8e6d1 is scheduled to L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d with binding_index 1 {{(pid=102446) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 20 05:46:10.582453 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-6e83def4-c921-4aa1-8e60-4a54db25af9d None None] Provisioning complete for port 9eda8635-539a-432d-895a-c89c930d86ba triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:46:10.582841 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-6e83def4-c921-4aa1-8e60-4a54db25af9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:10.621537 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-6e83def4-c921-4aa1-8e60-4a54db25af9d None None] Port 9eda8635-539a-432d-895a-c89c930d86ba cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:46:10.654118 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:46:10.660916 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-85e0ee42-e72b-4fd2-a6ac-d843123d2cf6 admin admin] 10.222.0.46 "PUT /v2.0/routers/9bc11af8-d43c-4231-b1b8-449221a8e6d1/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.9790008 Dec 20 05:46:10.669976 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Sync routers for ids ['9bc11af8-d43c-4231-b1b8-449221a8e6d1'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:46:10.686336 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Routers {'9bc11af8-d43c-4231-b1b8-449221a8e6d1'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:46:10.687335 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:46:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['9bc11af8-d43c-4231-b1b8-449221a8e6d1'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:46:10.889616 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Set router 9bc11af8-d43c-4231-b1b8-449221a8e6d1 gateway port host: None {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:46:11.349315 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'name': 'router1', 'tenant_id': 'f5349c1409984e8a89584df12177526e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:45:59Z', 'updated_at': '2021-12-20T05:46:09Z', 'revision_number': 2, 'project_id': 'f5349c1409984e8a89584df12177526e', 'gw_port_host': None, '_interfaces': [{'id': '9eda8635-539a-432d-895a-c89c930d86ba', 'name': '', 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649', 'tenant_id': 'f5349c1409984e8a89584df12177526e', 'mac_address': 'fa:16:3e:81:5c:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'bcf0d14b-8550-49a8-8d1e-9257c9132881', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:46:08Z', 'updated_at': '2021-12-20T05:46:10Z', 'revision_number': 2, 'project_id': 'f5349c1409984e8a89584df12177526e', 'subnets': [{'id': 'bcf0d14b-8550-49a8-8d1e-9257c9132881', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '9be4beba-d1f4-4452-8cfe-cb772cef4248'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:46:11.402024 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Checking router: 9bc11af8-d43c-4231-b1b8-449221a8e6d1 for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:46:11.402392 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Updating router 9bc11af8-d43c-4231-b1b8-449221a8e6d1 port 9eda8635-539a-432d-895a-c89c930d86ba binding host dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:46:11.454937 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:12.004177 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Publish callbacks [] for port, precommit_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:12.012263 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:12.182907 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Pushing event updated for resources: {'Port': ['ID=9eda8635-539a-432d-895a-c89c930d86ba,revision_number=3']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:46:12.187574 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Attempting to bind port 9eda8635-539a-432d-895a-c89c930d86ba on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:46:12.187977 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Attempting to bind port 9eda8635-539a-432d-895a-c89c930d86ba by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': 'b0cca571-baf9-400a-a1ed-b28c3c2cd814', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649'}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:46:12.188431 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Attempting to bind port 9eda8635-539a-432d-895a-c89c930d86ba on network 4fc15cd7-f679-42bc-bda7-c6ea17902649 {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:46:12.196341 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:46:12.196694 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:46:12.197042 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:46:12.197377 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:46:12.197709 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:46:12.198039 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:46:12.198362 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:46:12.198684 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:46:12.199010 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:46:12.199613 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:46:12.199942 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:46:12.200260 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:46:12.200574 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Tracked resource versions report: Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: pushed versions: Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: { 'AddressGroup': {'1.2'}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'ConntrackHelper': {'1.0'}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'LocalIPAssociation': {'1.0'}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Log': {'1.0'}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Network': {'1.1'}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Port': {'1.7'}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'PortForwarding': {'1.2'}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'QosPolicy': {'1.10'}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'SecurityGroup': {'1.5'}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'SecurityGroupRule': {'1.2'}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'SubPort': {'1.0'}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Subnet': {'1.1'}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Trunk': {'1.1'}} Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: consumer versions: Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: { DHCP agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: L3 agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: Metadata agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: Metering agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: Open vSwitch agent@dv-cinder-822278-1-iscsi: { 'AddressGroup': '1.2', Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'ConntrackHelper': '1.0', Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'LocalIPAssociation': '1.0', Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Log': '1.0', Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Network': '1.1', Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Port': '1.7', Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'PortForwarding': '1.2', Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'QosPolicy': '1.10', Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'SecurityGroup': '1.5', Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'SecurityGroupRule': '1.2', Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'SubPort': '1.0', Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Subnet': '1.1', Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Trunk': '1.1'}} Dec 20 05:46:12.201966 dv-cinder-822278-1-iscsi neutron-server[102448]: {{(pid=102448) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 20 05:46:12.205495 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 46, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:46:12.205671 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Checking segment: {'id': 'b0cca571-baf9-400a-a1ed-b28c3c2cd814', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102448) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:46:12.206153 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:12.206525 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Bound using segment: {'id': 'b0cca571-baf9-400a-a1ed-b28c3c2cd814', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649'} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:46:12.207012 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Bound port: 9eda8635-539a-432d-895a-c89c930d86ba, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b0cca571-baf9-400a-a1ed-b28c3c2cd814', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649'}}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:46:12.207409 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:12.260018 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-2365e233-8dba-4949-9dd7-05219203974c None None] Provisioning complete for port 9eda8635-539a-432d-895a-c89c930d86ba triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:46:12.260623 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-2365e233-8dba-4949-9dd7-05219203974c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:12.277542 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] For port 9eda8635-539a-432d-895a-c89c930d86ba, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102448) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:46:12.295808 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-2365e233-8dba-4949-9dd7-05219203974c None None] Port 9eda8635-539a-432d-895a-c89c930d86ba cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:46:12.297899 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] For port 9eda8635-539a-432d-895a-c89c930d86ba, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=9eda8635-539a-432d-895a-c89c930d86ba,segment=NetworkSegment(b0cca571-baf9-400a-a1ed-b28c3c2cd814),segment_id=b0cca571-baf9-400a-a1ed-b28c3c2cd814)] {{(pid=102448) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:46:12.303301 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:12.363072 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c90893e8-44c1-4a2d-8877-c80b42e4cd27 None None] Pushing event updated for resources: {'Port': ['ID=9eda8635-539a-432d-895a-c89c930d86ba,revision_number=4']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:46:12.370511 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Routers {'9bc11af8-d43c-4231-b1b8-449221a8e6d1'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:46:12.371212 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:46:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['9bc11af8-d43c-4231-b1b8-449221a8e6d1'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:46:12.467364 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] Set router 9bc11af8-d43c-4231-b1b8-449221a8e6d1 gateway port host: None {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:46:12.517226 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-61883f4b-e87d-47fd-b418-4ba556b50087 None None] Provisioning complete for port 9eda8635-539a-432d-895a-c89c930d86ba triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:46:12.517715 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-61883f4b-e87d-47fd-b418-4ba556b50087 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:12.601694 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-61883f4b-e87d-47fd-b418-4ba556b50087 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:12.635070 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-61883f4b-e87d-47fd-b418-4ba556b50087 None None] For port 9eda8635-539a-432d-895a-c89c930d86ba, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=9eda8635-539a-432d-895a-c89c930d86ba,segment=NetworkSegment(b0cca571-baf9-400a-a1ed-b28c3c2cd814),segment_id=b0cca571-baf9-400a-a1ed-b28c3c2cd814)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:46:12.640151 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-61883f4b-e87d-47fd-b418-4ba556b50087 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:12.690504 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61883f4b-e87d-47fd-b418-4ba556b50087 None None] Pushing event updated for resources: {'Port': ['ID=9eda8635-539a-432d-895a-c89c930d86ba,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:46:12.698708 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'name': 'router1', 'tenant_id': 'f5349c1409984e8a89584df12177526e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:45:59Z', 'updated_at': '2021-12-20T05:46:09Z', 'revision_number': 2, 'project_id': 'f5349c1409984e8a89584df12177526e', 'gw_port_host': None, '_interfaces': [{'id': '9eda8635-539a-432d-895a-c89c930d86ba', 'name': '', 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649', 'tenant_id': 'f5349c1409984e8a89584df12177526e', 'mac_address': 'fa:16:3e:81:5c:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'bcf0d14b-8550-49a8-8d1e-9257c9132881', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:46:08Z', 'updated_at': '2021-12-20T05:46:12Z', 'revision_number': 4, 'project_id': 'f5349c1409984e8a89584df12177526e', 'subnets': [{'id': 'bcf0d14b-8550-49a8-8d1e-9257c9132881', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '9be4beba-d1f4-4452-8cfe-cb772cef4248'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:46:12.727834 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc365fd8-94a9-466c-a123-fcd31fc27495 None None] The sync data for ids ['9bc11af8-d43c-4231-b1b8-449221a8e6d1'] in dv-cinder-822278-1-iscsi is: [{'id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'name': 'router1', 'tenant_id': 'f5349c1409984e8a89584df12177526e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:45:59Z', 'updated_at': '2021-12-20T05:46:09Z', 'revision_number': 2, 'project_id': 'f5349c1409984e8a89584df12177526e', 'gw_port_host': None, '_interfaces': [{'id': '9eda8635-539a-432d-895a-c89c930d86ba', 'name': '', 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649', 'tenant_id': 'f5349c1409984e8a89584df12177526e', 'mac_address': 'fa:16:3e:81:5c:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'bcf0d14b-8550-49a8-8d1e-9257c9132881', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:46:08Z', 'updated_at': '2021-12-20T05:46:12Z', 'revision_number': 4, 'project_id': 'f5349c1409984e8a89584df12177526e', 'subnets': [{'id': 'bcf0d14b-8550-49a8-8d1e-9257c9132881', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '9be4beba-d1f4-4452-8cfe-cb772cef4248'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:46:13.181688 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39334) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:46:13.294839 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-334ec776-66fb-4d8c-8c8d-9f61d5847d2a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:46:13.296264 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-334ec776-66fb-4d8c-8c8d-9f61d5847d2a admin admin] 10.222.0.46 "GET /v2.0/networks/2e5c289b-6b36-4be8-98bd-7afaf0da3344 HTTP/1.1" status: 200 len: 842 time: 0.1135271 Dec 20 05:46:13.307086 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-4a8343dc-ec04-412f-9c11-628f15fa2144 admin admin] Request body: {'subnet': {'enable_dhcp': False, 'name': 'public-subnet', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'ip_version': 4}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:46:13.334862 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4a8343dc-ec04-412f-9c11-628f15fa2144 admin admin] Made reservation on behalf of bc3969fb5d1f430fa1fdc77337d8caaf for: {'subnet': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:46:13.337374 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4a8343dc-ec04-412f-9c11-628f15fa2144 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:13.650207 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.objects.ports [None req-4a8343dc-ec04-412f-9c11-628f15fa2144 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102446) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 20 05:46:13.650565 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4a8343dc-ec04-412f-9c11-628f15fa2144 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for subnet, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:13.707252 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a8343dc-ec04-412f-9c11-628f15fa2144 admin admin] Pushing event updated for resources: {'Subnet': ['ID=13c80048-1854-452a-96f1-f7b3d8117ba4,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:46:13.714698 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a8343dc-ec04-412f-9c11-628f15fa2144 admin admin] Checking segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:46:13.715045 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a8343dc-ec04-412f-9c11-628f15fa2144 admin admin] Network hostable DHCP agents. Network: 2e5c289b-6b36-4be8-98bd-7afaf0da3344, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102446) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:46:13.737717 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a8343dc-ec04-412f-9c11-628f15fa2144 admin admin] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102446) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:46:13.748944 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-4a8343dc-ec04-412f-9c11-628f15fa2144 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, 2e5c289b-6b36-4be8-98bd-7afaf0da3344) {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:46:13.753199 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a8343dc-ec04-412f-9c11-628f15fa2144 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:46:13.753871 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4a8343dc-ec04-412f-9c11-628f15fa2144 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:13.760841 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39a5e41f-ca48-4574-82fa-473319dfed22 None None] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:46:13.787540 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-4a8343dc-ec04-412f-9c11-628f15fa2144 admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4700379 Dec 20 05:46:13.883177 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7534344f-68cf-4746-8855-aa2b77e85aaa None None] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:46:16.290689 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39342) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:46:16.422883 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-bff37e30-e34b-4e2b-9d88-1da135c79afa admin admin] 10.222.0.46 "GET /v2.0/routers/9bc11af8-d43c-4231-b1b8-449221a8e6d1 HTTP/1.1" status: 200 len: 710 time: 0.1310723 Dec 20 05:46:16.515174 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2feaf804-880d-493d-a8be-4fc6b269f195 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:46:16.517095 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-2feaf804-880d-493d-a8be-4fc6b269f195 admin admin] 10.222.0.46 "GET /v2.0/networks/2e5c289b-6b36-4be8-98bd-7afaf0da3344 HTTP/1.1" status: 200 len: 886 time: 0.0877154 Dec 20 05:46:16.527063 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:46:16.889597 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:17.121875 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:17.195634 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:17.306091 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Allocated IP 172.27.3.119 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/5c6ab4a7-12fd-4b12-a718-8c6c00e5135e) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:46:17.409079 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:17.442392 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:17.481517 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:46:17.484232 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:46:17.487423 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:46:17.520170 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Pushing event updated for resources: {'Port': ['ID=5c6ab4a7-12fd-4b12-a718-8c6c00e5135e,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:46:17.741935 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:17.939174 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1703049', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1698362', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-25868'] for router, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:17.943251 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1703078', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1703056', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1703071', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1698497'] for router, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:18.137048 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Router 9bc11af8-d43c-4231-b1b8-449221a8e6d1 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:46:18.242438 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:46:18.247594 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] Publish callbacks [] for router, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:18.250489 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-3d796af6-0191-43ac-8bb6-9826a1b4da83 admin admin] 10.222.0.46 "PUT /v2.0/routers/9bc11af8-d43c-4231-b1b8-449221a8e6d1 HTTP/1.1" status: 200 len: 890 time: 1.7251356 Dec 20 05:46:19.532868 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 9eda8635-539a-432d-895a-c89c930d86ba up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:46:19.584514 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 9eda8635-539a-432d-895a-c89c930d86ba triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:46:19.584789 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:19.780042 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Sync routers for ids ['9bc11af8-d43c-4231-b1b8-449221a8e6d1'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:46:19.791313 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Routers {'9bc11af8-d43c-4231-b1b8-449221a8e6d1'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:46:19.792069 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:46:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['9bc11af8-d43c-4231-b1b8-449221a8e6d1'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:46:20.008335 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Set router 9bc11af8-d43c-4231-b1b8-449221a8e6d1 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:46:20.479028 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'name': 'router1', 'tenant_id': 'f5349c1409984e8a89584df12177526e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': '5c6ab4a7-12fd-4b12-a718-8c6c00e5135e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:45:59Z', 'updated_at': '2021-12-20T05:46:17Z', 'revision_number': 4, 'project_id': 'f5349c1409984e8a89584df12177526e', 'gw_port': {'id': '5c6ab4a7-12fd-4b12-a718-8c6c00e5135e', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:44:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:46:17Z', 'updated_at': '2021-12-20T05:46:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '9eda8635-539a-432d-895a-c89c930d86ba', 'name': '', 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649', 'tenant_id': 'f5349c1409984e8a89584df12177526e', 'mac_address': 'fa:16:3e:81:5c:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'bcf0d14b-8550-49a8-8d1e-9257c9132881', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:46:08Z', 'updated_at': '2021-12-20T05:46:12Z', 'revision_number': 5, 'project_id': 'f5349c1409984e8a89584df12177526e', 'subnets': [{'id': 'bcf0d14b-8550-49a8-8d1e-9257c9132881', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '9be4beba-d1f4-4452-8cfe-cb772cef4248'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:46:20.530545 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Checking router: 9bc11af8-d43c-4231-b1b8-449221a8e6d1 for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:46:20.530899 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Updating router 9bc11af8-d43c-4231-b1b8-449221a8e6d1 port 5c6ab4a7-12fd-4b12-a718-8c6c00e5135e binding host dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:46:20.582243 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:20.902503 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Publish callbacks [] for port, precommit_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:20.909063 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:20.936173 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39354) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:46:20.964932 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e73e067-bbb4-4214-96ad-3fdd13193114 None None] Pushing event updated for resources: {'Port': ['ID=5c6ab4a7-12fd-4b12-a718-8c6c00e5135e,revision_number=2']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:46:20.970917 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Attempting to bind port 5c6ab4a7-12fd-4b12-a718-8c6c00e5135e on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:46:20.970917 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Attempting to bind port 5c6ab4a7-12fd-4b12-a718-8c6c00e5135e by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:46:20.970917 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Attempting to bind port 5c6ab4a7-12fd-4b12-a718-8c6c00e5135e on network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:46:20.974897 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 46, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:46:20.975277 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Checking segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:46:20.975742 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:20.976255 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Bound using segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:46:20.977253 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Bound port: 5c6ab4a7-12fd-4b12-a718-8c6c00e5135e, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:46:20.977722 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:21.027169 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] For port 5c6ab4a7-12fd-4b12-a718-8c6c00e5135e, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:46:21.030115 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] For port 5c6ab4a7-12fd-4b12-a718-8c6c00e5135e, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=5c6ab4a7-12fd-4b12-a718-8c6c00e5135e,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:46:21.035180 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:21.056944 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-ea056f1d-105a-49c1-9e92-6957241529ce admin admin] 10.222.0.46 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1196382 Dec 20 05:46:21.087260 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Routers {'9bc11af8-d43c-4231-b1b8-449221a8e6d1'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:46:21.087930 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:46:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['9bc11af8-d43c-4231-b1b8-449221a8e6d1'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:46:21.142400 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e73e067-bbb4-4214-96ad-3fdd13193114 None None] Pushing event updated for resources: {'Port': ['ID=5c6ab4a7-12fd-4b12-a718-8c6c00e5135e,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:46:21.232173 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] Set router 9bc11af8-d43c-4231-b1b8-449221a8e6d1 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:46:21.459471 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'name': 'router1', 'tenant_id': 'f5349c1409984e8a89584df12177526e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': '5c6ab4a7-12fd-4b12-a718-8c6c00e5135e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:45:59Z', 'updated_at': '2021-12-20T05:46:17Z', 'revision_number': 4, 'project_id': 'f5349c1409984e8a89584df12177526e', 'gw_port': {'id': '5c6ab4a7-12fd-4b12-a718-8c6c00e5135e', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:44:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:46:17Z', 'updated_at': '2021-12-20T05:46:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '9eda8635-539a-432d-895a-c89c930d86ba', 'name': '', 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649', 'tenant_id': 'f5349c1409984e8a89584df12177526e', 'mac_address': 'fa:16:3e:81:5c:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'bcf0d14b-8550-49a8-8d1e-9257c9132881', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:46:08Z', 'updated_at': '2021-12-20T05:46:12Z', 'revision_number': 5, 'project_id': 'f5349c1409984e8a89584df12177526e', 'subnets': [{'id': 'bcf0d14b-8550-49a8-8d1e-9257c9132881', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '9be4beba-d1f4-4452-8cfe-cb772cef4248'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:46:21.485550 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8cd79dac-3c83-4cb8-89b1-33bac2567f72 None None] The sync data for ids ['9bc11af8-d43c-4231-b1b8-449221a8e6d1'] in dv-cinder-822278-1-iscsi is: [{'id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'name': 'router1', 'tenant_id': 'f5349c1409984e8a89584df12177526e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.119'}], 'enable_snat': True}, 'gw_port_id': '5c6ab4a7-12fd-4b12-a718-8c6c00e5135e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:45:59Z', 'updated_at': '2021-12-20T05:46:17Z', 'revision_number': 4, 'project_id': 'f5349c1409984e8a89584df12177526e', 'gw_port': {'id': '5c6ab4a7-12fd-4b12-a718-8c6c00e5135e', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:44:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:46:17Z', 'updated_at': '2021-12-20T05:46:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '9eda8635-539a-432d-895a-c89c930d86ba', 'name': '', 'network_id': '4fc15cd7-f679-42bc-bda7-c6ea17902649', 'tenant_id': 'f5349c1409984e8a89584df12177526e', 'mac_address': 'fa:16:3e:81:5c:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9bc11af8-d43c-4231-b1b8-449221a8e6d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'bcf0d14b-8550-49a8-8d1e-9257c9132881', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:46:08Z', 'updated_at': '2021-12-20T05:46:12Z', 'revision_number': 5, 'project_id': 'f5349c1409984e8a89584df12177526e', 'subnets': [{'id': 'bcf0d14b-8550-49a8-8d1e-9257c9132881', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '9be4beba-d1f4-4452-8cfe-cb772cef4248'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:46:23.557720 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 5c6ab4a7-12fd-4b12-a718-8c6c00e5135e up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:46:23.626804 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 5c6ab4a7-12fd-4b12-a718-8c6c00e5135e triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:46:23.627181 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:23.711796 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:23.734093 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port 5c6ab4a7-12fd-4b12-a718-8c6c00e5135e, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=5c6ab4a7-12fd-4b12-a718-8c6c00e5135e,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:46:23.745748 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:23.816489 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=5c6ab4a7-12fd-4b12-a718-8c6c00e5135e,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:46:25.546969 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 5c6ab4a7-12fd-4b12-a718-8c6c00e5135e up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:46:25.625057 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 5c6ab4a7-12fd-4b12-a718-8c6c00e5135e triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:46:25.625917 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:30.982874 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 5 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:46:31.685132 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-141fdcbd-08d8-429c-8666-b6dacaf58939 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:34.119232 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-a5276ee2-3db7-4688-9010-33ce9694ee32 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:34.929062 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:36.374122 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:46:37.550568 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:01.683606 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-9e3f0b13-4239-4f09-a8ca-963cae6400ca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:04.127381 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-84cc6e36-1dd3-47ae-aead-a1f3fe6bbd63 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:04.967755 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:06.381228 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:07.548481 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:07.981263 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 5 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:47:31.681909 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-7a0931e1-b723-48d7-b992-2a86b63e2d7f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:34.121771 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-db9c463f-a3ca-413b-a6b5-685c580028b9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:34.929649 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:36.381649 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:37.554712 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:43.318892 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39838) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:47:43.381228 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.pecan_wsgi.hooks.translation [None req-f98038cd-bbca-4405-b8ef-962984c5eafb admin admin] GET failed (client error): The resource could not be found. Dec 20 05:47:43.382568 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-f98038cd-bbca-4405-b8ef-962984c5eafb admin admin] 10.222.0.46 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0626736 Dec 20 05:47:43.573961 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b6ad019e-acfe-4e05-9568-3a6e7dd3e855 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:47:43.575371 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-b6ad019e-acfe-4e05-9568-3a6e7dd3e855 admin admin] 10.222.0.46 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1879158 Dec 20 05:47:44.979990 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 5 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:47:46.012047 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 39848) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:47:46.127678 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41ee3e96-e787-41ce-bc6a-ad2fa755df7e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:47:46.129031 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-41ee3e96-e787-41ce-bc6a-ad2fa755df7e admin admin] 10.222.0.46 "GET /v2.0/subnets/bcf0d14b-8550-49a8-8d1e-9257c9132881 HTTP/1.1" status: 200 len: 849 time: 0.1160333 Dec 20 05:47:46.139078 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:47:46.219680 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Publish callbacks [] for subnet, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:46.366319 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8746767255525'] for subnet, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:46.400454 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:47:46.401064 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:46.402342 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] 10.222.0.46 "PUT /v2.0/subnets/bcf0d14b-8550-49a8-8d1e-9257c9132881 HTTP/1.1" status: 200 len: 868 time: 0.2668862 Dec 20 05:47:46.414555 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2aa0b67-6def-4777-af05-fd6493c1b97a None None] Network 4fc15cd7-f679-42bc-bda7-c6ea17902649 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:47:46.421899 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Pushing event updated for resources: {'Subnet': ['ID=bcf0d14b-8550-49a8-8d1e-9257c9132881,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:47:46.429604 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:47:46.429972 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:47:46.430318 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:47:46.430653 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:47:46.431462 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:47:46.431462 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:47:46.431789 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:47:46.431995 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:47:46.432340 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:47:46.432670 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:47:46.432992 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:47:46.433307 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:47:46.433623 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd39a638-9a64-4133-ad99-430ec4c0b9ad admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:47:46.717732 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-ff85edb8-113c-4d73-9f01-f02f680cf9d6 None None] Provisioning complete for port 9eda8635-539a-432d-895a-c89c930d86ba triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:47:46.718108 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ff85edb8-113c-4d73-9f01-f02f680cf9d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:46.807734 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-ff85edb8-113c-4d73-9f01-f02f680cf9d6 None None] Provisioning complete for port 6e3a6dee-f72f-4045-b370-472e3e63e568 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:47:46.807992 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ff85edb8-113c-4d73-9f01-f02f680cf9d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:47:48.803396 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39858) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:47:49.005277 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2acdd059-c57f-40be-88d9-57ca4db4a2f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:47:49.005668 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2acdd059-c57f-40be-88d9-57ca4db4a2f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:47:49.007231 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-2acdd059-c57f-40be-88d9-57ca4db4a2f7 admin admin] 10.222.0.46 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2028325 Dec 20 05:47:51.406576 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39866) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:47:51.537515 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b809e7c-f604-492d-86af-abf2a6d92fd3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:47:51.537991 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b809e7c-f604-492d-86af-abf2a6d92fd3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:47:51.539582 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-6b809e7c-f604-492d-86af-abf2a6d92fd3 admin admin] 10.222.0.46 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1320260 Dec 20 05:47:53.932314 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39874) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:47:54.058796 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c00950e-8e95-4d7e-9e91-36c69f215b66 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:47:54.060258 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-0c00950e-8e95-4d7e-9e91-36c69f215b66 admin admin] 10.222.0.46 "GET /v2.0/networks/2e5c289b-6b36-4be8-98bd-7afaf0da3344 HTTP/1.1" status: 200 len: 886 time: 0.1269646 Dec 20 05:47:56.486924 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39882) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:47:56.618180 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b47ad82-3f32-4377-90ce-39f9961ceb95 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:47:56.619582 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-6b47ad82-3f32-4377-90ce-39f9961ceb95 admin admin] 10.222.0.46 "GET /v2.0/networks/4fc15cd7-f679-42bc-bda7-c6ea17902649 HTTP/1.1" status: 200 len: 869 time: 0.1316619 Dec 20 05:47:58.987844 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39890) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:47:59.114108 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a66e88d4-9c30-4de5-b205-3f03cb823835 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:47:59.114591 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a66e88d4-9c30-4de5-b205-3f03cb823835 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:47:59.119230 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-a66e88d4-9c30-4de5-b205-3f03cb823835 admin admin] 10.222.0.46 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1303935 Dec 20 05:48:01.552425 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39898) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:48:01.645845 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ad6e5f8-9605-487b-9e83-d914a510ae9f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:48:01.646212 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ad6e5f8-9605-487b-9e83-d914a510ae9f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:48:01.647755 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-8ad6e5f8-9605-487b-9e83-d914a510ae9f admin admin] 10.222.0.46 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0943649 Dec 20 05:48:01.675823 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8ae2af8e-e0df-4297-980e-e89351eb3fbb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:04.062635 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39906) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:48:04.122920 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-090dbba7-5e47-4bdc-90b3-a13f50f69606 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:04.154780 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0d2b21c-51d6-49d4-b13f-e9be6076511d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:48:04.156329 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-c0d2b21c-51d6-49d4-b13f-e9be6076511d admin admin] 10.222.0.46 "GET /v2.0/subnets/13c80048-1854-452a-96f1-f7b3d8117ba4 HTTP/1.1" status: 200 len: 816 time: 0.0927427 Dec 20 05:48:04.933411 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:06.384919 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:06.587909 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39914) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:48:06.679584 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59c34606-ded7-4e13-bbd8-62c22fa81bb5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:48:06.681521 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-59c34606-ded7-4e13-bbd8-62c22fa81bb5 admin admin] 10.222.0.46 "GET /v2.0/subnets/bcf0d14b-8550-49a8-8d1e-9257c9132881 HTTP/1.1" status: 200 len: 868 time: 0.0924995 Dec 20 05:48:07.547105 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:21.979360 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 5 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:48:31.680084 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-edad19c8-e63c-452e-b6fd-4cec68207063 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:31.811310 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39968) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:48:31.860136 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [None req-537dc637-abd3-4723-9390-d395bbae2a0d admin admin] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102446) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 05:48:31.861145 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-537dc637-abd3-4723-9390-d395bbae2a0d admin admin] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0491657 Dec 20 05:48:34.125171 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-5d209d68-72dd-4f41-8b14-4d76479e5017 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:34.345328 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39976) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:48:34.407067 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.pecan_wsgi.hooks.translation [None req-ea474cb3-05f4-4746-a780-2f8f52349ed2 admin admin] GET failed (client error): The resource could not be found. Dec 20 05:48:34.408832 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-ea474cb3-05f4-4746-a780-2f8f52349ed2 admin admin] 10.222.0.46 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0624428 Dec 20 05:48:34.498911 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ec2ad29-b8c6-40fe-b535-e976ded3c6c1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:48:34.500606 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-5ec2ad29-b8c6-40fe-b535-e976ded3c6c1 admin admin] 10.222.0.46 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.0873015 Dec 20 05:48:34.936868 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:36.388601 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:36.967744 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39984) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:48:37.014493 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'shared', 'shared': True}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:48:37.036692 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Made reservation on behalf of bc3969fb5d1f430fa1fdc77337d8caaf for: {'network': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:48:37.038924 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:37.065718 dv-cinder-822278-1-iscsi neutron-server[102446]: WARNING neutron.services.revisions.revision_plugin [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Could not find related network for resource to bump revision. Dec 20 05:48:37.076341 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] vlan segment allocate from pool success with {'vlan_id': 432, 'physical_network': 'physnet1'} {{(pid=102446) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:48:37.085603 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:37.085933 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.segments_db [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Added segment e75dfcc1-ca2a-46c6-a0aa-251ee070119b of type vlan for network c26632c1-19ed-44a7-b956-a61862e2b6b0 Dec 20 05:48:37.124615 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:37.147610 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:37.148802 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:48:37.149397 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:37.190706 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.2215643 Dec 20 05:48:37.230831 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Pushing event updated for resources: {'Network': ['ID=c26632c1-19ed-44a7-b956-a61862e2b6b0,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:48:37.239160 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:37.239563 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:37.239915 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:37.240253 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:37.240588 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:37.240912 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:37.241266 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:37.241599 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:37.241922 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:37.242262 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:37.242588 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:37.242905 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:37.243222 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34640713-f55f-4355-926d-d0ab2f50024b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:37.254622 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network c26632c1-19ed-44a7-b956-a61862e2b6b0 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:48:37.554466 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:39.618851 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 39992) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:48:39.679397 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.pecan_wsgi.hooks.translation [None req-048a8726-10b9-4eb5-8c7b-f08ebf874858 admin admin] GET failed (client error): The resource could not be found. Dec 20 05:48:39.680717 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-048a8726-10b9-4eb5-8c7b-f08ebf874858 admin admin] 10.222.0.46 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0608969 Dec 20 05:48:39.749501 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2ecd7b6-b6e2-4be5-9f79-f0d9b269a1f8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:48:39.750970 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-b2ecd7b6-b6e2-4be5-9f79-f0d9b269a1f8 admin admin] 10.222.0.46 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0656013 Dec 20 05:48:39.761767 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-deebfd43-9f8b-49b2-b071-804e52f94507 admin admin] Request body: {'subnet': {'description': 'shared-subnet', 'network_id': 'c26632c1-19ed-44a7-b956-a61862e2b6b0', 'name': 'shared-subnet', 'ip_version': 4, 'cidr': '192.168.233.0/24'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:48:39.782846 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-deebfd43-9f8b-49b2-b071-804e52f94507 admin admin] Made reservation on behalf of bc3969fb5d1f430fa1fdc77337d8caaf for: {'subnet': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:48:39.785077 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-deebfd43-9f8b-49b2-b071-804e52f94507 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:40.042812 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-deebfd43-9f8b-49b2-b071-804e52f94507 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for subnet, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:40.098395 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deebfd43-9f8b-49b2-b071-804e52f94507 admin admin] Pushing event updated for resources: {'Subnet': ['ID=af5b09fe-0910-495b-aaf9-ec3ee59fc9a5,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:48:40.106560 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-deebfd43-9f8b-49b2-b071-804e52f94507 admin admin] Checking segment: {'id': 'e75dfcc1-ca2a-46c6-a0aa-251ee070119b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'c26632c1-19ed-44a7-b956-a61862e2b6b0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:48:40.106909 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-deebfd43-9f8b-49b2-b071-804e52f94507 admin admin] Network hostable DHCP agents. Network: c26632c1-19ed-44a7-b956-a61862e2b6b0, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102446) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:48:40.123059 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-deebfd43-9f8b-49b2-b071-804e52f94507 admin admin] Network c26632c1-19ed-44a7-b956-a61862e2b6b0 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102446) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:48:40.131814 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-deebfd43-9f8b-49b2-b071-804e52f94507 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, c26632c1-19ed-44a7-b956-a61862e2b6b0) {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:48:40.135942 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-deebfd43-9f8b-49b2-b071-804e52f94507 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:48:40.136521 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-deebfd43-9f8b-49b2-b071-804e52f94507 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:40.142565 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17308750-67fb-4b89-bad8-1ebb80bcad56 None None] Network c26632c1-19ed-44a7-b956-a61862e2b6b0 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:48:40.152064 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-deebfd43-9f8b-49b2-b071-804e52f94507 admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3936334 Dec 20 05:48:40.244745 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf82c7edd-7168-52b9-b9ff-dee431eec71c-c26632c1-19ed-44a7-b956-a61862e2b6b0', 'network_id': 'c26632c1-19ed-44a7-b956-a61862e2b6b0', 'project_id': 'bc3969fb5d1f430fa1fdc77337d8caaf', 'fixed_ips': [{'subnet_id': 'af5b09fe-0910-495b-aaf9-ec3ee59fc9a5'}]}} from dv-cinder-822278-1-iscsi. {{(pid=102447) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 20 05:48:40.245943 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:40.393727 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.db_base_plugin_common [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Allocated IP 192.168.233.2 (c26632c1-19ed-44a7-b956-a61862e2b6b0/af5b09fe-0910-495b-aaf9-ec3ee59fc9a5/da7404d6-013f-4307-be68-e2cd22b508d3) {{(pid=102447) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:48:40.538646 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Publish callbacks [] for port, precommit_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:40.545966 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:40.591243 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Network c26632c1-19ed-44a7-b956-a61862e2b6b0 is already hosted by enough agents. {{(pid=102447) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:48:40.594328 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.base_scheduler [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Resources bound (agent type, host, resource id): {{(pid=102447) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:48:40.603017 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Received port after_create {{(pid=102447) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:48:40.605441 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Pushing event updated for resources: {'Port': ['ID=da7404d6-013f-4307-be68-e2cd22b508d3,revision_number=1']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:48:40.614644 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:40.615016 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:40.615356 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:40.615711 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:40.616360 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:40.616360 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:40.616657 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:40.616978 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:40.617620 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:40.617620 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:40.618010 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:40.618248 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:40.618557 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:48:40.677618 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Attempting to bind port da7404d6-013f-4307-be68-e2cd22b508d3 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:48:40.677827 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Attempting to bind port da7404d6-013f-4307-be68-e2cd22b508d3 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': 'e75dfcc1-ca2a-46c6-a0aa-251ee070119b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'c26632c1-19ed-44a7-b956-a61862e2b6b0'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:48:40.678142 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Attempting to bind port da7404d6-013f-4307-be68-e2cd22b508d3 on network c26632c1-19ed-44a7-b956-a61862e2b6b0 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:48:40.683156 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 48, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:48:40.683555 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Checking segment: {'id': 'e75dfcc1-ca2a-46c6-a0aa-251ee070119b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'c26632c1-19ed-44a7-b956-a61862e2b6b0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:48:40.683961 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:40.684354 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Bound using segment: {'id': 'e75dfcc1-ca2a-46c6-a0aa-251ee070119b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'c26632c1-19ed-44a7-b956-a61862e2b6b0'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:48:40.684819 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Bound port: da7404d6-013f-4307-be68-e2cd22b508d3, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e75dfcc1-ca2a-46c6-a0aa-251ee070119b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'c26632c1-19ed-44a7-b956-a61862e2b6b0'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:48:40.685242 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:40.843894 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] For port da7404d6-013f-4307-be68-e2cd22b508d3, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:48:40.848046 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] For port da7404d6-013f-4307-be68-e2cd22b508d3, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=da7404d6-013f-4307-be68-e2cd22b508d3,segment=NetworkSegment(e75dfcc1-ca2a-46c6-a0aa-251ee070119b),segment_id=e75dfcc1-ca2a-46c6-a0aa-251ee070119b)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:48:40.853490 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:40.920268 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e2aaceb-d210-42ef-a669-ff58dfc0e911 None None] Pushing event updated for resources: {'Port': ['ID=da7404d6-013f-4307-be68-e2cd22b508d3,revision_number=2']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:48:41.624950 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device da7404d6-013f-4307-be68-e2cd22b508d3 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:48:41.684729 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port da7404d6-013f-4307-be68-e2cd22b508d3 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:48:41.685095 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:41.765633 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-876040a4-4dc4-4a4f-9e09-ca30f7df621f None None] Network c26632c1-19ed-44a7-b956-a61862e2b6b0 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:48:41.785651 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:41.868620 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port da7404d6-013f-4307-be68-e2cd22b508d3, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=da7404d6-013f-4307-be68-e2cd22b508d3,segment=NetworkSegment(e75dfcc1-ca2a-46c6-a0aa-251ee070119b),segment_id=e75dfcc1-ca2a-46c6-a0aa-251ee070119b)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:48:41.880354 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:41.935747 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-1e11c651-2e81-4779-a667-37785c850382 None None] Provisioning complete for port da7404d6-013f-4307-be68-e2cd22b508d3 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:48:41.936118 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-1e11c651-2e81-4779-a667-37785c850382 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:41.974136 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=da7404d6-013f-4307-be68-e2cd22b508d3,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:48:42.358796 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-c7603ea0-27d2-4cc3-a9c6-78d642d3b176 None None] Provisioning complete for port da7404d6-013f-4307-be68-e2cd22b508d3 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:48:42.359158 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-c7603ea0-27d2-4cc3-a9c6-78d642d3b176 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:43.574557 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device da7404d6-013f-4307-be68-e2cd22b508d3 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:48:43.627655 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port da7404d6-013f-4307-be68-e2cd22b508d3 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:48:43.628026 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:48:58.978204 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 5 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:49:01.682446 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-4ebb0a26-4ed6-4f44-8541-99b0cf5f4091 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:04.128836 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f43bb2d5-4b18-481b-9cd3-a4fe4da1bd3d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:04.939817 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:06.392029 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:07.548800 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:31.685093 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-5e2bb726-7040-4ae2-9f00-309ae301f315 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:34.131989 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-b95608aa-d9fa-40f9-a63d-c430cfdb0838 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:34.942466 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:35.976836 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 5 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:49:36.395138 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:37.557078 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:58.341306 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40038) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:49:58.347318 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [None req-2c4d2796-e0a2-4eb6-9b60-051baf3a396a tempest-verify_tempest_config-988262456 tempest-verify_tempest_config-988262456-project] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 05:49:58.348343 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-2c4d2796-e0a2-4eb6-9b60-051baf3a396a tempest-verify_tempest_config-988262456 tempest-verify_tempest_config-988262456-project] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0060501 Dec 20 05:49:58.646586 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 40056) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:49:58.753522 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:58.827650 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:58.831869 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:58.880097 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ec8389c0-8ccf-456e-92e6-f7e32d6cd6ee,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:49:58.884737 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=388a003551f74625bfccaacfe11fe9a4&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2371466 Dec 20 05:49:58.887589 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40062) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:49:58.889075 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:58.889452 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:58.889801 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:58.890139 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:58.890473 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:58.890806 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:58.891149 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:58.891529 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:58.891883 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:58.892383 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:58.892794 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:58.893148 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:58.893472 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f49c4483-2479-4e3a-b0db-216c0f170d21 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:58.970110 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:58.990826 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:59.084118 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:59.086933 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:49:59.088098 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/ec8389c0-8ccf-456e-92e6-f7e32d6cd6ee HTTP/1.1" status: 204 len: 168 time: 0.1995585 Dec 20 05:49:59.096408 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec8389c0-8ccf-456e-92e6-f7e32d6cd6ee,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:49:59.102839 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:59.103201 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:59.103564 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:59.103900 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:59.104227 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:59.104549 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:59.104892 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:59.105216 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:59.105547 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:59.105880 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:59.106199 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:59.106512 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:49:59.106824 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a272a20b-9c92-4025-847a-34b1ed13c79b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:50:01.686782 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-b0f4c796-e49e-42a0-a8b2-6bbcc6eafcfc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:50:04.135234 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-03f05966-47a5-409b-888a-3fbc9c60d323 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:50:04.944571 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:50:06.399938 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:50:07.550613 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:50:12.975249 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 5 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:50:31.689653 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-9e734a57-6001-4a0f-9b37-d7e73178011a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:50:34.137098 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-2edc0357-25f8-4f13-89de-e246969b11d2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:50:34.949830 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:50:36.399005 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:50:37.556754 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:50:49.974106 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 5 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:51:01.690741 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-636a6097-5d9e-4304-90dd-dd3a9378c5a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:51:04.139034 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-2f9c4ef9-f6da-42e3-993c-94b388a089ea None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:51:04.949921 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:51:06.403482 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:51:07.550345 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:51:26.973343 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 5 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:51:31.695959 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-6ced1f4a-ff8d-46ca-b5f4-108c143bf839 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:51:34.141343 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-66945af9-335e-4cc0-a18f-213891ef9447 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:51:34.953225 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:51:36.406997 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:51:37.337094 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1697183'] for agent, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:51:37.553173 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:51:50.903359 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40134) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:51:51.010305 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-d422ad80-9cd8-4398-878b-7c3ee61e1bf1 admin admin] 10.222.0.46 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1057842 Dec 20 05:51:53.544796 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40144) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:51:53.602953 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-b9b74542-1cda-4523-9ecd-8a94974827a1 admin admin] 10.222.0.46 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0570419 Dec 20 05:52:01.699377 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-381c168d-9252-4edc-8566-b64d088f3988 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:52:03.971874 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:52:04.143006 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ce68d531-a761-457e-9691-2f62bd313da3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:52:04.956945 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:52:06.409798 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:52:07.285296 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:52:07.555641 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:52:31.702638 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-89eabd7b-8a2f-405e-afe7-e0fd1af472dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:52:34.143803 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-9fc3c04f-a042-4ae8-8627-dfb3570413ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:52:34.958835 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:52:36.412624 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:52:37.282560 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:52:37.559212 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:52:40.970417 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:53:01.705947 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-3155dfd0-bc1f-4505-8c28-c3bb7b0b53cc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:04.146457 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-1cf67525-3ee1-4636-a554-4534443d1a8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:04.961936 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:06.416593 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:07.297985 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:07.561721 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:17.968972 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:53:22.546366 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40332) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:22.757856 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1089933753-network', 'tenant_id': '2ffd6c4703134e94b747f03bda57e076'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:22.784291 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Made reservation on behalf of 2ffd6c4703134e94b747f03bda57e076 for: {'network': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:53:22.788406 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:22.802046 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:22.909875 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:22.914697 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:22.943273 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] vlan segment allocate from pool success with {'vlan_id': 426, 'physical_network': 'physnet1'} {{(pid=102445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:53:22.957115 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c6b7a99-e092-41e3-8114-c4404723cbd0,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:22.963863 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8746767306114', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:22.964650 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Unsubscribe: segment precommit_create {{(pid=102445) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 20 05:53:22.965226 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.segments_db [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Added segment bb43682f-2240-467e-b9ff-f7edf582b7d1 of type vlan for network 43c0c2bb-3a2a-478c-b157-c23e2b672361 Dec 20 05:53:22.982608 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:22.983054 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:22.983835 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:22.983983 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:22.984338 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:22.984730 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:22.985105 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:22.985427 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:22.985753 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:22.986143 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:22.986654 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:22.986995 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:22.987316 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Tracked resource versions report: Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: pushed versions: Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: { 'AddressGroup': {'1.2'}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'ConntrackHelper': {'1.0'}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'LocalIPAssociation': {'1.0'}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Log': {'1.0'}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Network': {'1.1'}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Port': {'1.7'}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'PortForwarding': {'1.2'}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'QosPolicy': {'1.10'}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'SecurityGroup': {'1.5'}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'SecurityGroupRule': {'1.2'}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'SubPort': {'1.0'}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Subnet': {'1.1'}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Trunk': {'1.1'}} Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: consumer versions: Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: { DHCP agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: HyperV agent@hv-cinder-82227: {}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: L3 agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: Metadata agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: Metering agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: Open vSwitch agent@dv-cinder-822278-1-iscsi: { 'AddressGroup': '1.2', Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'ConntrackHelper': '1.0', Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'LocalIPAssociation': '1.0', Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Log': '1.0', Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Network': '1.1', Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Port': '1.7', Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'PortForwarding': '1.2', Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'QosPolicy': '1.10', Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'SecurityGroup': '1.5', Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'SecurityGroupRule': '1.2', Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'SubPort': '1.0', Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Subnet': '1.1', Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: 'Trunk': '1.1'}} Dec 20 05:53:22.988585 dv-cinder-822278-1-iscsi neutron-server[102445]: {{(pid=102445) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 20 05:53:23.034409 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:23.065969 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:23.067162 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:23.067887 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:23.137820 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.5903955 Dec 20 05:53:23.140891 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 40366) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:23.147114 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Request body: {'subnet': {'network_id': '43c0c2bb-3a2a-478c-b157-c23e2b672361', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1089933753-subnet', 'tenant_id': '2ffd6c4703134e94b747f03bda57e076', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:23.167266 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f95ae6d3-2532-4115-8e93-279bf4f075e7 admin admin] Pushing event updated for resources: {'Network': ['ID=43c0c2bb-3a2a-478c-b157-c23e2b672361,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:23.171339 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Made reservation on behalf of 2ffd6c4703134e94b747f03bda57e076 for: {'subnet': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:53:23.174013 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:23.178680 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network 43c0c2bb-3a2a-478c-b157-c23e2b672361 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:53:23.387317 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for subnet, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:23.435874 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Pushing event updated for resources: {'Subnet': ['ID=385e0f7c-479c-4f5c-84eb-a5a7aeba6f4c,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:23.448712 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40380) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:23.460176 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:23.460829 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:23.461187 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:23.461535 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:23.461876 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:23.462207 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:23.462542 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:23.462871 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:23.463773 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:23.464148 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:23.464486 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:23.464813 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:23.467022 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Tracked resource versions report: Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: pushed versions: Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: { 'AddressGroup': {'1.2'}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'ConntrackHelper': {'1.0'}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'LocalIPAssociation': {'1.0'}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Log': {'1.0'}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Network': {'1.1'}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Port': {'1.7'}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'PortForwarding': {'1.2'}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'QosPolicy': {'1.10'}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'SecurityGroup': {'1.5'}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'SecurityGroupRule': {'1.2'}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'SubPort': {'1.0'}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Subnet': {'1.1'}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Trunk': {'1.1'}} Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: consumer versions: Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: { DHCP agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: HyperV agent@hv-cinder-82227: {}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: L3 agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: Metadata agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: Metering agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: Open vSwitch agent@dv-cinder-822278-1-iscsi: { 'AddressGroup': '1.2', Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'ConntrackHelper': '1.0', Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'LocalIPAssociation': '1.0', Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Log': '1.0', Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Network': '1.1', Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Port': '1.7', Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'PortForwarding': '1.2', Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'QosPolicy': '1.10', Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'SecurityGroup': '1.5', Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'SecurityGroupRule': '1.2', Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'SubPort': '1.0', Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Subnet': '1.1', Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: 'Trunk': '1.1'}} Dec 20 05:53:23.468263 dv-cinder-822278-1-iscsi neutron-server[102446]: {{(pid=102446) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 20 05:53:23.492789 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Checking segment: {'id': 'bb43682f-2240-467e-b9ff-f7edf582b7d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': '43c0c2bb-3a2a-478c-b157-c23e2b672361'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:53:23.493232 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Network hostable DHCP agents. Network: 43c0c2bb-3a2a-478c-b157-c23e2b672361, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102446) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:53:23.513860 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Network 43c0c2bb-3a2a-478c-b157-c23e2b672361 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102446) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:53:23.528710 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, 43c0c2bb-3a2a-478c-b157-c23e2b672361) {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:53:23.533576 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:23.534164 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:23.541965 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af547be1-b193-4124-ba13-823182c1a60f None None] Network 43c0c2bb-3a2a-478c-b157-c23e2b672361 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:53:23.551141 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-ee7314ef-a78f-4470-a59f-51282d26d292 admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.4085774 Dec 20 05:53:23.643174 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-307dca3d-b494-423c-abff-10dbc63ca976 None None] Network 43c0c2bb-3a2a-478c-b157-c23e2b672361 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:53:23.693279 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-2143347886-network', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:23.727836 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] Made reservation on behalf of 1898b7c1b3dc4523b09a97486622c67e for: {'network': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:53:23.730322 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:23.738993 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:23.824415 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:23.829738 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:23.857086 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] vlan segment allocate from pool success with {'vlan_id': 449, 'physical_network': 'physnet1'} {{(pid=102445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:53:23.866553 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=50504936-7d4c-4908-9138-fcb0de702a40,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:23.871408 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:23.871774 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.segments_db [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] Added segment 4c69b482-aa23-4498-a353-7596fb491ef0 of type vlan for network 6924a88e-10c1-4073-a41c-88aad14ebd0f Dec 20 05:53:23.922598 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:24.007001 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:24.007001 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:24.007001 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:24.010271 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 40414) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:24.011118 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.5582178 Dec 20 05:53:24.017376 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-d29e8a3b-330c-4c07-9ceb-b8f32a497d00 admin admin] Request body: {'subnet': {'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-2143347886-subnet', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:24.041524 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d87854-8e5a-4fd6-9975-075863d590d7 admin admin] Pushing event updated for resources: {'Network': ['ID=6924a88e-10c1-4073-a41c-88aad14ebd0f,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:24.043373 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d29e8a3b-330c-4c07-9ceb-b8f32a497d00 admin admin] Made reservation on behalf of 1898b7c1b3dc4523b09a97486622c67e for: {'subnet': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:53:24.045958 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d29e8a3b-330c-4c07-9ceb-b8f32a497d00 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:24.052075 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network 6924a88e-10c1-4073-a41c-88aad14ebd0f details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:53:24.232195 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d29e8a3b-330c-4c07-9ceb-b8f32a497d00 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for subnet, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:24.290136 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d29e8a3b-330c-4c07-9ceb-b8f32a497d00 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ffb588f9-2ffb-4921-8a76-be5179c2fbed,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:24.302061 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d29e8a3b-330c-4c07-9ceb-b8f32a497d00 admin admin] Checking segment: {'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:53:24.302414 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d29e8a3b-330c-4c07-9ceb-b8f32a497d00 admin admin] Network hostable DHCP agents. Network: 6924a88e-10c1-4073-a41c-88aad14ebd0f, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102446) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:53:24.322583 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d29e8a3b-330c-4c07-9ceb-b8f32a497d00 admin admin] Network 6924a88e-10c1-4073-a41c-88aad14ebd0f is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102446) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:53:24.333016 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-d29e8a3b-330c-4c07-9ceb-b8f32a497d00 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, 6924a88e-10c1-4073-a41c-88aad14ebd0f) {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:53:24.338906 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d29e8a3b-330c-4c07-9ceb-b8f32a497d00 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:24.339793 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d29e8a3b-330c-4c07-9ceb-b8f32a497d00 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:24.344501 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d82e9afb-06cd-4c60-850c-b818cd62e5bc None None] Network 6924a88e-10c1-4073-a41c-88aad14ebd0f requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:53:24.362252 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-d29e8a3b-330c-4c07-9ceb-b8f32a497d00 admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3504937 Dec 20 05:53:24.366354 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 40432) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:24.372680 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:24.439541 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1698740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25959'] for router, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:24.442069 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1698340', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1703163', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1634740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25982'] for router, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:24.495452 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf82c7edd-7168-52b9-b9ff-dee431eec71c-6924a88e-10c1-4073-a41c-88aad14ebd0f', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed'}]}} from dv-cinder-822278-1-iscsi. {{(pid=102447) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 20 05:53:24.496707 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:24.575268 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:24.692901 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.db_base_plugin_common [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Allocated IP 172.20.0.2 (6924a88e-10c1-4073-a41c-88aad14ebd0f/ffb588f9-2ffb-4921-8a76-be5179c2fbed/09374bc6-6f8e-4cbf-86e9-c35ec5fceb89) {{(pid=102447) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:53:24.761001 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:24.999350 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Publish callbacks [] for port, precommit_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:25.011358 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:25.112703 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Pushing event updated for resources: {'Port': ['ID=09374bc6-6f8e-4cbf-86e9-c35ec5fceb89,revision_number=1']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:25.121750 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Network 6924a88e-10c1-4073-a41c-88aad14ebd0f is already hosted by enough agents. {{(pid=102447) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:53:25.127183 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.base_scheduler [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Resources bound (agent type, host, resource id): {{(pid=102447) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:53:25.130805 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Received port after_create {{(pid=102447) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:53:25.134851 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:25.135296 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:25.135841 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:25.136270 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:25.136716 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:25.137136 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:25.137579 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:25.137962 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:25.138376 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:25.138809 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:25.139563 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:25.139563 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:25.140029 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Tracked resource versions report: Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: pushed versions: Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: { 'AddressGroup': {'1.2'}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'ConntrackHelper': {'1.0'}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'LocalIPAssociation': {'1.0'}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Log': {'1.0'}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Network': {'1.1'}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Port': {'1.7'}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'PortForwarding': {'1.2'}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'QosPolicy': {'1.10'}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'SecurityGroup': {'1.5'}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'SecurityGroupRule': {'1.2'}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'SubPort': {'1.0'}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Subnet': {'1.1'}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Trunk': {'1.1'}} Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: consumer versions: Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: { DHCP agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: HyperV agent@hv-cinder-82227: {}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: L3 agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: Metadata agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: Metering agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: Open vSwitch agent@dv-cinder-822278-1-iscsi: { 'AddressGroup': '1.2', Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'ConntrackHelper': '1.0', Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'LocalIPAssociation': '1.0', Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Log': '1.0', Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Network': '1.1', Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Port': '1.7', Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'PortForwarding': '1.2', Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'QosPolicy': '1.10', Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'SecurityGroup': '1.5', Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'SecurityGroupRule': '1.2', Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'SubPort': '1.0', Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Subnet': '1.1', Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: 'Trunk': '1.1'}} Dec 20 05:53:25.141490 dv-cinder-822278-1-iscsi neutron-server[102447]: {{(pid=102447) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 20 05:53:25.152974 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:25.178209 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:25.214365 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Attempting to bind port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:53:25.214823 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Attempting to bind port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:53:25.215530 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Attempting to bind port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 on network 6924a88e-10c1-4073-a41c-88aad14ebd0f {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:53:25.221067 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 53, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:53:25.221726 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Checking segment: {'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:53:25.222771 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:25.223498 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Bound using segment: {'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:53:25.224195 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Bound port: 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:53:25.225013 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:25.311483 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] For port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:53:25.320039 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] For port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=09374bc6-6f8e-4cbf-86e9-c35ec5fceb89,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:53:25.328064 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:25.341969 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Allocated IP 172.27.3.228 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/7b5cd9b9-b9f4-4ee3-a49d-93c291685413) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:53:25.424086 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adf1a9e6-e38a-4db0-8fdf-c7f27d5a1b7e None None] Pushing event updated for resources: {'Port': ['ID=09374bc6-6f8e-4cbf-86e9-c35ec5fceb89,revision_number=2']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:25.484202 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:25.538499 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:25.598495 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:53:25.599819 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Pushing event updated for resources: {'Port': ['ID=7b5cd9b9-b9f4-4ee3-a49d-93c291685413,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:25.603752 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:53:25.605831 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:53:25.906179 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:25.956366 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40532) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:26.215069 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40548) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:26.218480 dv-cinder-822278-1-iscsi neutron-server[102445]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 20 05:53:26.252206 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1698355', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1703078'] for router, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:26.449437 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Router 3f858ad2-b10f-4f04-9727-f99638a01796 is scheduled to L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d with binding_index 1 {{(pid=102446) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 20 05:53:26.505141 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-69856e15-5b5d-4721-843e-7ae58b2478fb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:26.507150 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40558) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:26.600802 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-9cd4b8c1-8726-4eb5-93fd-f0e777da4025 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:26.607850 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-9cd4b8c1-8726-4eb5-93fd-f0e777da4025 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/networks?id=43c0c2bb-3a2a-478c-b157-c23e2b672361 HTTP/1.1" status: 200 len: 812 time: 0.3905921 Dec 20 05:53:26.676212 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-70f83679-a0ee-4611-a45a-e4080349a3ed tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/quotas/2ffd6c4703134e94b747f03bda57e076 HTTP/1.1" status: 200 len: 375 time: 0.0672884 Dec 20 05:53:26.680796 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:53:26.692917 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Sync routers for ids ['3f858ad2-b10f-4f04-9727-f99638a01796'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:53:26.706999 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Routers {'3f858ad2-b10f-4f04-9727-f99638a01796'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:53:26.707681 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:53:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['3f858ad2-b10f-4f04-9727-f99638a01796'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:53:26.714879 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-69856e15-5b5d-4721-843e-7ae58b2478fb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:26.731288 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] Publish callbacks [] for router, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:26.736969 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-cab4cb6d-2981-4f92-86eb-41a2e1c04818 admin admin] 10.222.0.46 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.3693681 Dec 20 05:53:26.738447 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 40590) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:26.807057 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-877cef93-5ce9-470b-b3a5-9ef6773e1990 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=2ffd6c4703134e94b747f03bda57e076&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0896637 Dec 20 05:53:26.808643 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-69856e15-5b5d-4721-843e-7ae58b2478fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:26.889265 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-69856e15-5b5d-4721-843e-7ae58b2478fb admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=b0c697c66b5a48509a649d69bd179a15&name=default HTTP/1.1" status: 200 len: 2992 time: 0.9317167 Dec 20 05:53:26.894786 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40604) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:26.896086 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69856e15-5b5d-4721-843e-7ae58b2478fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ae985a8-ba25-425a-9ac2-f1fb95e44414,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:26.925045 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-140c3beb-543c-419c-a4e1-59ddc78d895e None None] Network 6924a88e-10c1-4073-a41c-88aad14ebd0f requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:53:26.964468 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3adf1b6d-4d90-4eb3-b678-93180e545738 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:26.998424 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3adf1b6d-4d90-4eb3-b678-93180e545738 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.030113 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Set router 3f858ad2-b10f-4f04-9727-f99638a01796 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:53:27.045528 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-80c57a41-2166-4187-8be6-00b67da8a085 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.069916 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3adf1b6d-4d90-4eb3-b678-93180e545738 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.073020 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3adf1b6d-4d90-4eb3-b678-93180e545738 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.077419 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-3adf1b6d-4d90-4eb3-b678-93180e545738 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/8ae985a8-ba25-425a-9ac2-f1fb95e44414 HTTP/1.1" status: 204 len: 168 time: 0.1778533 Dec 20 05:53:27.090992 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3adf1b6d-4d90-4eb3-b678-93180e545738 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ae985a8-ba25-425a-9ac2-f1fb95e44414,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:27.177243 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-80c57a41-2166-4187-8be6-00b67da8a085 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.182994 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-80c57a41-2166-4187-8be6-00b67da8a085 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.184653 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-ec77974a-0689-466c-965b-f01484dac7b1 None None] Provisioning complete for port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:53:27.185606 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ec77974a-0689-466c-965b-f01484dac7b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.296670 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-80c57a41-2166-4187-8be6-00b67da8a085 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=61bfe4964d334644b4b7042d9ea9a804&name=default HTTP/1.1" status: 200 len: 2992 time: 0.7773309 Dec 20 05:53:27.298689 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40614) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:27.299664 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80c57a41-2166-4187-8be6-00b67da8a085 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a95f6280-72c7-4232-88fb-444d093762f5,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:27.361726 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ec77974a-0689-466c-965b-f01484dac7b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.374805 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a91303f5-1601-433e-b834-6c07dc2c2a58 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.398417 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:25Z', 'revision_number': 3, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:25Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:53:27.400705 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a91303f5-1601-433e-b834-6c07dc2c2a58 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.416641 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-ec77974a-0689-466c-965b-f01484dac7b1 None None] For port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=09374bc6-6f8e-4cbf-86e9-c35ec5fceb89,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:53:27.423941 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ec77974a-0689-466c-965b-f01484dac7b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.481396 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a91303f5-1601-433e-b834-6c07dc2c2a58 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.490137 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a91303f5-1601-433e-b834-6c07dc2c2a58 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.501376 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-a91303f5-1601-433e-b834-6c07dc2c2a58 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/a95f6280-72c7-4232-88fb-444d093762f5 HTTP/1.1" status: 204 len: 168 time: 0.1934161 Dec 20 05:53:27.533841 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec77974a-0689-466c-965b-f01484dac7b1 None None] Pushing event updated for resources: {'Port': ['ID=09374bc6-6f8e-4cbf-86e9-c35ec5fceb89,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:27.536255 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-600e238d-fff6-4ccd-984e-c2b2a11b5284 service neutron] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 05:53:27.539749 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Checking router: 3f858ad2-b10f-4f04-9727-f99638a01796 for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:53:27.548936 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-600e238d-fff6-4ccd-984e-c2b2a11b5284 service neutron] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.4903657 Dec 20 05:53:27.551201 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a91303f5-1601-433e-b834-6c07dc2c2a58 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a95f6280-72c7-4232-88fb-444d093762f5,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:27.552045 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Updating router 3f858ad2-b10f-4f04-9727-f99638a01796 port 7b5cd9b9-b9f4-4ee3-a49d-93c291685413 binding host dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:53:27.563093 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 40622) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:27.596807 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.607475 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 40626) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:27.752813 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-3bbbe690-5723-4be5-8967-26b9b6d30a56 service neutron] 10.222.0.46 "GET /v2.0/networks/43c0c2bb-3a2a-478c-b157-c23e2b672361?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2028534 Dec 20 05:53:27.852672 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-dfface8f-fae3-4511-bd14-d29d59a0b634 None None] Provisioning complete for port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:53:27.860838 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-dfface8f-fae3-4511-bd14-d29d59a0b634 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:27.964634 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:53:27.969392 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-d723b80e-5510-4308-a98d-bf9c80706052 service neutron] 10.222.0.46 "GET /v2.0/networks/43c0c2bb-3a2a-478c-b157-c23e2b672361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2152061 Dec 20 05:53:28.000170 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.224770 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:53:28.225723 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.250999 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Publish callbacks [] for port, precommit_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.265248 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.294818 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9d10d606-f816-47ba-9e99-50c1f39d86c8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.372297 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Allocated IP 172.20.0.1 (6924a88e-10c1-4073-a41c-88aad14ebd0f/ffb588f9-2ffb-4921-8a76-be5179c2fbed/313310c9-f961-4d30-aedb-324e4e6e1a26) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:53:28.481836 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Attempting to bind port 7b5cd9b9-b9f4-4ee3-a49d-93c291685413 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:53:28.482355 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Attempting to bind port 7b5cd9b9-b9f4-4ee3-a49d-93c291685413 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:53:28.482814 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Attempting to bind port 7b5cd9b9-b9f4-4ee3-a49d-93c291685413 on network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:53:28.498019 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Pushing event updated for resources: {'Port': ['ID=7b5cd9b9-b9f4-4ee3-a49d-93c291685413,revision_number=2']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:28.512105 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-38fdbfc5-4855-4db2-a369-667f46879167 req-44ee7af9-8915-4a5c-b5c9-92ba71325897 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 210 time: 0.1183784 Dec 20 05:53:28.523528 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 53, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:53:28.524983 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Checking segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102448) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:53:28.525727 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.526738 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Bound using segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:53:28.528614 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Bound port: 7b5cd9b9-b9f4-4ee3-a49d-93c291685413, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:53:28.530353 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.566983 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:28.573973 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:28.577326 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:28.577733 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:28.578064 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:28.579890 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40678) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:28.581437 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:28.582219 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:28.582566 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:28.585259 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:28.585880 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:28.587412 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:28.587930 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:28.593373 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Tracked resource versions report: Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: pushed versions: Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: { 'AddressGroup': {'1.2'}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'ConntrackHelper': {'1.0'}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'LocalIPAssociation': {'1.0'}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Log': {'1.0'}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Network': {'1.1'}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Port': {'1.7'}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'PortForwarding': {'1.2'}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'QosPolicy': {'1.10'}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'SecurityGroup': {'1.5'}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'SecurityGroupRule': {'1.2'}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'SubPort': {'1.0'}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Subnet': {'1.1'}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Trunk': {'1.1'}} Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: consumer versions: Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: { DHCP agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: HyperV agent@hv-cinder-82227: {}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: L3 agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: Metadata agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: Metering agent@dv-cinder-822278-1-iscsi: {}, Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: Open vSwitch agent@dv-cinder-822278-1-iscsi: { 'AddressGroup': '1.2', Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'ConntrackHelper': '1.0', Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'LocalIPAssociation': '1.0', Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Log': '1.0', Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Network': '1.1', Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Port': '1.7', Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'PortForwarding': '1.2', Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'QosPolicy': '1.10', Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'SecurityGroup': '1.5', Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'SecurityGroupRule': '1.2', Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'SubPort': '1.0', Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Subnet': '1.1', Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: 'Trunk': '1.1'}} Dec 20 05:53:28.595038 dv-cinder-822278-1-iscsi neutron-server[102448]: {{(pid=102448) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 20 05:53:28.600614 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-439020ef-257c-4f0e-aa17-e640291cf231 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.620047 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5df20b0e-a591-468b-b2f2-39eeadc6d6ea admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.669915 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] For port 7b5cd9b9-b9f4-4ee3-a49d-93c291685413, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102448) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:53:28.675963 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] For port 7b5cd9b9-b9f4-4ee3-a49d-93c291685413, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=7b5cd9b9-b9f4-4ee3-a49d-93c291685413,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102448) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:53:28.683483 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.737264 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-439020ef-257c-4f0e-aa17-e640291cf231 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.743977 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-439020ef-257c-4f0e-aa17-e640291cf231 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.783924 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.814094 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-439020ef-257c-4f0e-aa17-e640291cf231 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=21e42179654b48289f281d719acbebd1&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2292674 Dec 20 05:53:28.817758 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40686) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:28.818470 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-439020ef-257c-4f0e-aa17-e640291cf231 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc709a3d-1353-4269-a035-08e494afa125,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:28.891044 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Routers {'3f858ad2-b10f-4f04-9727-f99638a01796'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:53:28.891741 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:53:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['3f858ad2-b10f-4f04-9727-f99638a01796'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:53:28.896552 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5df20b0e-a591-468b-b2f2-39eeadc6d6ea admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.900977 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-349c9438-4cf2-4119-9519-684e424625d3 None None] Pushing event updated for resources: {'Port': ['ID=7b5cd9b9-b9f4-4ee3-a49d-93c291685413,revision_number=3']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:28.935095 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5df20b0e-a591-468b-b2f2-39eeadc6d6ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.955889 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4d08eb72-a2d0-41bd-b70f-d19b66676f90 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:28.983322 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4d08eb72-a2d0-41bd-b70f-d19b66676f90 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.006604 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.015057 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40696) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:29.016234 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-5df20b0e-a591-468b-b2f2-39eeadc6d6ea admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=22f33f0619404c828d615bdb246a6c69&name=default HTTP/1.1" status: 200 len: 2992 time: 1.4519064 Dec 20 05:53:29.070293 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] Set router 3f858ad2-b10f-4f04-9727-f99638a01796 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:53:29.083339 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-15055e21-7af7-4172-882b-9b65291f2f14 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.096650 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4d08eb72-a2d0-41bd-b70f-d19b66676f90 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.099725 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4d08eb72-a2d0-41bd-b70f-d19b66676f90 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.101194 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-4d08eb72-a2d0-41bd-b70f-d19b66676f90 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/cc709a3d-1353-4269-a035-08e494afa125 HTTP/1.1" status: 204 len: 168 time: 0.2794404 Dec 20 05:53:29.122214 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Pushing event updated for resources: {'Port': ['ID=313310c9-f961-4d30-aedb-324e4e6e1a26,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:29.123863 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-15055e21-7af7-4172-882b-9b65291f2f14 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.140149 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d08eb72-a2d0-41bd-b70f-d19b66676f90 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc709a3d-1353-4269-a035-08e494afa125,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:29.148332 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Network 6924a88e-10c1-4073-a41c-88aad14ebd0f is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:53:29.153297 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:53:29.164386 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:53:29.165177 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1703675'] for router_interface, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.254816 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9d10d606-f816-47ba-9e99-50c1f39d86c8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.258515 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-15055e21-7af7-4172-882b-9b65291f2f14 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.261485 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-15055e21-7af7-4172-882b-9b65291f2f14 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.262806 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-15055e21-7af7-4172-882b-9b65291f2f14 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/1cc7b51f-bc90-40aa-8eee-857d253f91c2 HTTP/1.1" status: 204 len: 168 time: 0.2461765 Dec 20 05:53:29.266202 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9d10d606-f816-47ba-9e99-50c1f39d86c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.280450 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15055e21-7af7-4172-882b-9b65291f2f14 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1cc7b51f-bc90-40aa-8eee-857d253f91c2,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:29.297770 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5df20b0e-a591-468b-b2f2-39eeadc6d6ea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1cc7b51f-bc90-40aa-8eee-857d253f91c2,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:29.394113 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d10d606-f816-47ba-9e99-50c1f39d86c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7886d1aa-1385-4153-b97a-bf66c38a1f18,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:29.434797 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40714) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:29.440267 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-9d10d606-f816-47ba-9e99-50c1f39d86c8 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=e6db627d95b54a2ab5c864e0050c80c5&name=default HTTP/1.1" status: 200 len: 2992 time: 1.8253553 Dec 20 05:53:29.476914 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:25Z', 'revision_number': 3, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:53:29.541614 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-954be4e3-e2e1-4736-836d-c1259b8ebb57 None None] The sync data for ids ['3f858ad2-b10f-4f04-9727-f99638a01796'] in dv-cinder-822278-1-iscsi is: [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:25Z', 'revision_number': 3, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:53:29.554422 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a73a0be1-38ee-41a6-84f5-b429339ac2de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.577585 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.593217 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a73a0be1-38ee-41a6-84f5-b429339ac2de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.664849 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a73a0be1-38ee-41a6-84f5-b429339ac2de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.668429 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a73a0be1-38ee-41a6-84f5-b429339ac2de admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.692268 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-a73a0be1-38ee-41a6-84f5-b429339ac2de admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/7886d1aa-1385-4153-b97a-bf66c38a1f18 HTTP/1.1" status: 204 len: 168 time: 0.2534945 Dec 20 05:53:29.695957 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-4d5df405-81eb-49bb-bb01-9712bb13921b None None] Provisioning complete for port 313310c9-f961-4d30-aedb-324e4e6e1a26 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:53:29.696577 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-4d5df405-81eb-49bb-bb01-9712bb13921b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:29.764907 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-393be948-c4e4-43d8-b9d4-633b1c5e2765 req-7c34d066-60cc-4c3d-8a34-d660a92ed411 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 210 time: 0.0713642 Dec 20 05:53:29.770769 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a73a0be1-38ee-41a6-84f5-b429339ac2de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7886d1aa-1385-4153-b97a-bf66c38a1f18,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:29.820621 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-4d5df405-81eb-49bb-bb01-9712bb13921b None None] Port 313310c9-f961-4d30-aedb-324e4e6e1a26 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:53:30.124845 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:30.131298 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:30.132081 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1617520', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1697131'] for router_interface, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:30.296063 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Pushing event updated for resources: {'Port': ['ID=313310c9-f961-4d30-aedb-324e4e6e1a26,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:30.318221 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 40756) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:30.353232 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d1d09c7-d726-455b-bd86-33dcf36a0e6a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:30.368316 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Network 6924a88e-10c1-4073-a41c-88aad14ebd0f is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:53:30.372743 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:53:30.571375 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40762) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:30.595042 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-6d049445-d737-47d5-ae90-64a9ea397bff admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:30.624722 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Router 3f858ad2-b10f-4f04-9727-f99638a01796 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:53:30.661686 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d1d09c7-d726-455b-bd86-33dcf36a0e6a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:30.721071 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d1d09c7-d726-455b-bd86-33dcf36a0e6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:30.739030 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-6d049445-d737-47d5-ae90-64a9ea397bff admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:30.746297 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-6d049445-d737-47d5-ae90-64a9ea397bff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:30.761529 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-305f65b0-40c5-4039-a3cc-722e82623ebf None None] Provisioning complete for port 313310c9-f961-4d30-aedb-324e4e6e1a26 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:53:30.762036 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-305f65b0-40c5-4039-a3cc-722e82623ebf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:30.784352 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d1d09c7-d726-455b-bd86-33dcf36a0e6a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19b506ff-46a0-4086-94fe-d6bdee037ab8,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:30.811459 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-0d1d09c7-d726-455b-bd86-33dcf36a0e6a admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=d79e501e326e46fabb7f407bea74aef9&name=default HTTP/1.1" status: 200 len: 2992 time: 0.4888222 Dec 20 05:53:30.814578 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 40772) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:30.865193 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-305f65b0-40c5-4039-a3cc-722e82623ebf None None] Port 313310c9-f961-4d30-aedb-324e4e6e1a26 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:53:30.891852 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-6d049445-d737-47d5-ae90-64a9ea397bff admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=ae3c4c0d9d8e479a806de5427a9b6a88&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3125758 Dec 20 05:53:30.892798 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 40778) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:30.895777 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d049445-d737-47d5-ae90-64a9ea397bff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b07a49ef-241a-42f1-9d38-1a5e8f8dd95c,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:31.055615 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-eac29f9a-bb16-4353-9ede-aa58f203da83 req-ffdf93a6-b1c2-42ec-afe7-8ad0b8be84cc tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 210 time: 0.0416324 Dec 20 05:53:31.085354 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:53:31.100888 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-1a1a67d0-58fc-42f9-93b6-443789d3b378 admin admin] 10.222.0.46 "PUT /v2.0/routers/3f858ad2-b10f-4f04-9727-f99638a01796/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3511817 Dec 20 05:53:31.100888 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d324608a-786d-4d2f-94d6-39e7a3213434 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:31.130419 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d324608a-786d-4d2f-94d6-39e7a3213434 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:31.165823 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d98dcdc7-3eac-4e67-9256-b4f0bf289ce1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:31.193530 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d98dcdc7-3eac-4e67-9256-b4f0bf289ce1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:31.215349 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d324608a-786d-4d2f-94d6-39e7a3213434 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:31.217468 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d324608a-786d-4d2f-94d6-39e7a3213434 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:31.218589 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-d324608a-786d-4d2f-94d6-39e7a3213434 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/b07a49ef-241a-42f1-9d38-1a5e8f8dd95c HTTP/1.1" status: 204 len: 168 time: 0.3196642 Dec 20 05:53:31.238013 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d324608a-786d-4d2f-94d6-39e7a3213434 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b07a49ef-241a-42f1-9d38-1a5e8f8dd95c,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:31.270694 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d98dcdc7-3eac-4e67-9256-b4f0bf289ce1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:31.274361 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d98dcdc7-3eac-4e67-9256-b4f0bf289ce1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:31.277345 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-d98dcdc7-3eac-4e67-9256-b4f0bf289ce1 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/19b506ff-46a0-4086-94fe-d6bdee037ab8 HTTP/1.1" status: 204 len: 168 time: 0.4594541 Dec 20 05:53:31.287126 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d98dcdc7-3eac-4e67-9256-b4f0bf289ce1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19b506ff-46a0-4086-94fe-d6bdee037ab8,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:31.715951 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-2b27e07f-9eed-4f5f-ba44-f217ef7acc76 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:31.793859 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 7b5cd9b9-b9f4-4ee3-a49d-93c291685413 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:53:31.903018 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 7b5cd9b9-b9f4-4ee3-a49d-93c291685413 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:53:31.903471 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:32.113219 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:32.149725 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Sync routers for ids ['3f858ad2-b10f-4f04-9727-f99638a01796'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:53:32.201176 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port 7b5cd9b9-b9f4-4ee3-a49d-93c291685413, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=7b5cd9b9-b9f4-4ee3-a49d-93c291685413,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:53:32.224782 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:32.251498 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Routers {'3f858ad2-b10f-4f04-9727-f99638a01796'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:53:32.253032 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:53:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['3f858ad2-b10f-4f04-9727-f99638a01796'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:53:32.312053 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0150e397-8c50-45cb-b005-d02753c39b12 req-83437bd5-4c35-4271-b88d-75708a0e0805 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 210 time: 0.0671172 Dec 20 05:53:32.411774 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=7b5cd9b9-b9f4-4ee3-a49d-93c291685413,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:32.482137 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Set router 3f858ad2-b10f-4f04-9727-f99638a01796 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:53:32.784616 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.54', 56729) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:32.811544 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40886) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:32.817488 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-d09cdf43-bbe9-4ce4-8d9c-270ef5409624 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Request body: {'security_group': {'name': 'tempest-securitygroup--992702336', 'description': 'tempest-description--1699900098'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:32.870492 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d09cdf43-bbe9-4ce4-8d9c-270ef5409624 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:32.883593 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 2, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:53:32.945081 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Checking router: 3f858ad2-b10f-4f04-9727-f99638a01796 for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:53:32.945709 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Updating router 3f858ad2-b10f-4f04-9727-f99638a01796 port 313310c9-f961-4d30-aedb-324e4e6e1a26 binding host dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:53:32.990316 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.066012 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d09cdf43-bbe9-4ce4-8d9c-270ef5409624 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.074777 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d09cdf43-bbe9-4ce4-8d9c-270ef5409624 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.164272 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d09cdf43-bbe9-4ce4-8d9c-270ef5409624 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.166694 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-d09cdf43-bbe9-4ce4-8d9c-270ef5409624 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.3530793 Dec 20 05:53:33.170114 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40908) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:33.176186 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-78f7801a-58fc-4fe5-8f22-ec1d330485d8 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Request body: {'security_group_rule': {'security_group_id': '38e9df07-f897-436d-ac60-fe287113cf14', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:33.182772 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d09cdf43-bbe9-4ce4-8d9c-270ef5409624 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event updated for resources: {'SecurityGroup': ['ID=38e9df07-f897-436d-ac60-fe287113cf14,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:33.224211 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-78f7801a-58fc-4fe5-8f22-ec1d330485d8 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.358672 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-78f7801a-58fc-4fe5-8f22-ec1d330485d8 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.366738 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-78f7801a-58fc-4fe5-8f22-ec1d330485d8 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.398924 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f7801a-58fc-4fe5-8f22-ec1d330485d8 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=aa611e9b-8899-4114-98f1-598e1ef7be79,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:33.399952 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-1cc48054-36be-465c-be9e-f956ba8d3b63 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:33.402233 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-1cc48054-36be-465c-be9e-f956ba8d3b63 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.54 "GET /v2.0/networks?id=43c0c2bb-3a2a-478c-b157-c23e2b672361 HTTP/1.1" status: 200 len: 812 time: 0.5972850 Dec 20 05:53:33.419215 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-78f7801a-58fc-4fe5-8f22-ec1d330485d8 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.423033 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-78f7801a-58fc-4fe5-8f22-ec1d330485d8 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2505584 Dec 20 05:53:33.425632 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40930) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:33.432530 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-aca7bd94-8b7a-4e5a-8c30-e7a905c4c94b tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Request body: {'security_group_rule': {'security_group_id': '38e9df07-f897-436d-ac60-fe287113cf14', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:33.505780 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-c95f1f8f-ec6a-4c4a-983d-b614ec3d5bec tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Request body: {'port': {'device_id': '3c23e2c6-db4c-4766-8571-6e612c92168e', 'network_id': '43c0c2bb-3a2a-478c-b157-c23e2b672361', 'admin_state_up': True, 'tenant_id': '2ffd6c4703134e94b747f03bda57e076'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:33.529440 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cbe6e9f0-c2ac-42af-a552-1f7ea1214103 req-61d234ce-0ffb-411f-8414-bdca315ebc60 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 210 time: 0.0839198 Dec 20 05:53:33.555174 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-aca7bd94-8b7a-4e5a-8c30-e7a905c4c94b tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.663031 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-aca7bd94-8b7a-4e5a-8c30-e7a905c4c94b tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.672439 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-aca7bd94-8b7a-4e5a-8c30-e7a905c4c94b tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.692161 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Publish callbacks [] for port, precommit_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.719976 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.757950 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca7bd94-8b7a-4e5a-8c30-e7a905c4c94b tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0000ce95-b22e-48a8-b521-782c927a71e7,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:33.786006 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-aca7bd94-8b7a-4e5a-8c30-e7a905c4c94b tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.791861 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-aca7bd94-8b7a-4e5a-8c30-e7a905c4c94b tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3650277 Dec 20 05:53:33.792666 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 40952) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:33.804263 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Request body: {'floatingip': {'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:33.826510 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 7b5cd9b9-b9f4-4ee3-a49d-93c291685413 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:53:33.868853 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for floatingip, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:33.981867 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de30976-0971-422f-bfec-1b38e3a25db2 None None] Pushing event updated for resources: {'Port': ['ID=313310c9-f961-4d30-aedb-324e4e6e1a26,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:34.018282 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-c95f1f8f-ec6a-4c4a-983d-b614ec3d5bec tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Made reservation on behalf of 2ffd6c4703134e94b747f03bda57e076 for: {'port': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:53:34.028460 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-c95f1f8f-ec6a-4c4a-983d-b614ec3d5bec tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:34.104306 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Attempting to bind port 313310c9-f961-4d30-aedb-324e4e6e1a26 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:53:34.104959 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Attempting to bind port 313310c9-f961-4d30-aedb-324e4e6e1a26 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:53:34.105474 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Attempting to bind port 313310c9-f961-4d30-aedb-324e4e6e1a26 on network 6924a88e-10c1-4073-a41c-88aad14ebd0f {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:53:34.120430 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 53, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:53:34.121219 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Checking segment: {'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:53:34.123623 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:34.124199 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Bound using segment: {'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:53:34.126298 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Bound port: 313310c9-f961-4d30-aedb-324e4e6e1a26, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:53:34.127013 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:34.181628 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 7b5cd9b9-b9f4-4ee3-a49d-93c291685413 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:53:34.182230 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:34.320718 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:34.327150 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8bad8ced-9e98-4c5a-86a4-fbf063fdcffe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:34.450209 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-c95f1f8f-ec6a-4c4a-983d-b614ec3d5bec tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Allocated IP 172.20.0.9 (43c0c2bb-3a2a-478c-b157-c23e2b672361/385e0f7c-479c-4f5c-84eb-a5a7aeba6f4c/04f78e54-1e12-4575-b3c2-165c19e74def) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:53:34.459126 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] For port 313310c9-f961-4d30-aedb-324e4e6e1a26, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:53:34.466390 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] For port 313310c9-f961-4d30-aedb-324e4e6e1a26, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=313310c9-f961-4d30-aedb-324e4e6e1a26,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:53:34.467743 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-20f22cf6-b440-4931-9c6b-231261870e8f None None] Provisioning complete for port 313310c9-f961-4d30-aedb-324e4e6e1a26 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:53:34.468174 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-20f22cf6-b440-4931-9c6b-231261870e8f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:34.494150 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:34.769873 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1f75707b-dee2-4254-94d2-4521b8cc4743 req-e19a0593-8396-488d-a163-3bbc73dfdc13 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 210 time: 0.0965693 Dec 20 05:53:34.837780 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Allocated IP 172.27.3.226 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/282f3699-8de1-47a6-9f34-99f6e5580c61) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:53:34.854293 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-c95f1f8f-ec6a-4c4a-983d-b614ec3d5bec tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:34.927395 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de30976-0971-422f-bfec-1b38e3a25db2 None None] Pushing event updated for resources: {'Port': ['ID=313310c9-f961-4d30-aedb-324e4e6e1a26,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:34.945102 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-c95f1f8f-ec6a-4c4a-983d-b614ec3d5bec tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:35.099826 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Routers {'3f858ad2-b10f-4f04-9727-f99638a01796'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:53:35.101466 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:53:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['3f858ad2-b10f-4f04-9727-f99638a01796'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:53:35.130735 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-c95f1f8f-ec6a-4c4a-983d-b614ec3d5bec tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Network 43c0c2bb-3a2a-478c-b157-c23e2b672361 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:53:35.143016 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-c95f1f8f-ec6a-4c4a-983d-b614ec3d5bec tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:53:35.156943 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-c95f1f8f-ec6a-4c4a-983d-b614ec3d5bec tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:53:35.165396 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-c95f1f8f-ec6a-4c4a-983d-b614ec3d5bec tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:35.166835 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-c95f1f8f-ec6a-4c4a-983d-b614ec3d5bec tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:35.197562 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:35.259871 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:35.273203 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c95f1f8f-ec6a-4c4a-983d-b614ec3d5bec tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Pushing event updated for resources: {'Port': ['ID=04f78e54-1e12-4575-b3c2-165c19e74def,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:35.289855 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-20f22cf6-b440-4931-9c6b-231261870e8f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:35.293801 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-c95f1f8f-ec6a-4c4a-983d-b614ec3d5bec tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7938201 Dec 20 05:53:35.335489 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-0e0ae816-f335-4d23-b6eb-c4774f94c7fc tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102446) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 05:53:35.340692 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-0e0ae816-f335-4d23-b6eb-c4774f94c7fc tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.54 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0321229 Dec 20 05:53:35.460853 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:35.519247 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-20f22cf6-b440-4931-9c6b-231261870e8f None None] For port 313310c9-f961-4d30-aedb-324e4e6e1a26, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=313310c9-f961-4d30-aedb-324e4e6e1a26,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:53:35.529890 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-20f22cf6-b440-4931-9c6b-231261870e8f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:35.656497 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20f22cf6-b440-4931-9c6b-231261870e8f None None] Pushing event updated for resources: {'Port': ['ID=313310c9-f961-4d30-aedb-324e4e6e1a26,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:35.678422 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:53:35.687135 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:53:35.697515 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] Set router 3f858ad2-b10f-4f04-9727-f99638a01796 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:53:35.707590 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:53:35.725777 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event updated for resources: {'Port': ['ID=282f3699-8de1-47a6-9f34-99f6e5580c61,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:35.988541 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-3fcd6fe9-801e-41ab-adc7-7bce7d7f0cc2 None None] Provisioning complete for port 313310c9-f961-4d30-aedb-324e4e6e1a26 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:53:35.988742 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-3fcd6fe9-801e-41ab-adc7-7bce7d7f0cc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:36.037965 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:36.239145 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:34Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:53:36.248404 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c445316b-88ba-4168-b601-c2d39e8ce331 req-80503bfd-0892-4244-8c94-eca7b92b314e tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:36.250047 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c445316b-88ba-4168-b601-c2d39e8ce331 req-80503bfd-0892-4244-8c94-eca7b92b314e tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 931 time: 0.3599269 Dec 20 05:53:36.275627 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41050) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:36.276489 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:36.286468 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Request body: {'port': {'device_id': '3c23e2c6-db4c-4766-8571-6e612c92168e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:36.326787 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2153375f-ebb8-407f-a523-f3252ca95ef6 None None] The sync data for ids ['3f858ad2-b10f-4f04-9727-f99638a01796'] in dv-cinder-822278-1-iscsi is: [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:34Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:53:36.488639 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:36.696895 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c445316b-88ba-4168-b601-c2d39e8ce331 req-6bee09e1-27da-462d-8225-af1979bc116a tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4404337 Dec 20 05:53:36.823943 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-655220bb-5d56-4c02-b31f-f8c83c61275e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:36.883560 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:37.055643 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:37.068133 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:37.115571 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:37.253191 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:37.256559 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.4624770 Dec 20 05:53:37.295667 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24e11833-74ae-4606-b697-551689b54c61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event updated for resources: {'Port': ['ID=282f3699-8de1-47a6-9f34-99f6e5580c61,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:37.345448 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:37.410220 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41092) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:37.579173 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:37.720546 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-de8e55e4-f2a7-4089-b4e1-2a55076e5a4b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:37.783392 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 04f78e54-1e12-4575-b3c2-165c19e74def {{(pid=102446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:53:37.820322 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:37.824353 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41122) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:37.868770 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.provisioning_blocks [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Transition to ACTIVE for port object 04f78e54-1e12-4575-b3c2-165c19e74def will not be triggered until provisioned by entity L2. {{(pid=102446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 05:53:37.885860 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 313310c9-f961-4d30-aedb-324e4e6e1a26 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:53:37.889444 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:38.053919 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-a4f660f6-5780-418d-8f0f-b82ca0a58532 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?name=tempest-securitygroup--992702336&fields=id&tenant_id=1898b7c1b3dc4523b09a97486622c67e HTTP/1.1" status: 200 len: 267 time: 0.2181516 Dec 20 05:53:38.087544 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-de8e55e4-f2a7-4089-b4e1-2a55076e5a4b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:38.110586 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 313310c9-f961-4d30-aedb-324e4e6e1a26 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:53:38.112128 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:38.155930 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-de8e55e4-f2a7-4089-b4e1-2a55076e5a4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:38.289385 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-655220bb-5d56-4c02-b31f-f8c83c61275e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:38.303032 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06995ff-c86f-43d5-b402-150f473da0af req-7f06bb4e-3a34-4bbc-b189-37c069aafcf0 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:38.304975 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e06995ff-c86f-43d5-b402-150f473da0af req-7f06bb4e-3a34-4bbc-b189-37c069aafcf0 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 943 time: 0.3824942 Dec 20 05:53:38.335910 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-de8e55e4-f2a7-4089-b4e1-2a55076e5a4b admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=10617a6fee1d4251b3fc958a3c020d96&name=default HTTP/1.1" status: 200 len: 2992 time: 0.9241965 Dec 20 05:53:38.349582 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41134) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:38.379792 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-655220bb-5d56-4c02-b31f-f8c83c61275e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:38.397960 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de8e55e4-f2a7-4089-b4e1-2a55076e5a4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a5d5632e-0ee6-46c0-89c2-92a2806461c7,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:38.474401 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-3adbcffb-602e-45e8-8739-537ba3235956 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:38.486196 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-3adbcffb-602e-45e8-8739-537ba3235956 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/networks?id=6924a88e-10c1-4073-a41c-88aad14ebd0f HTTP/1.1" status: 200 len: 811 time: 0.4312987 Dec 20 05:53:38.513337 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-655220bb-5d56-4c02-b31f-f8c83c61275e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da0d92d1-7098-4312-b08d-71b04ede546d,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:38.524748 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Pushing event updated for resources: {'Port': ['ID=04f78e54-1e12-4575-b3c2-165c19e74def,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:38.556414 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-d2648514-f705-481e-a257-30f19fd67e01 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/quotas/1898b7c1b3dc4523b09a97486622c67e HTTP/1.1" status: 200 len: 375 time: 0.0690854 Dec 20 05:53:38.644838 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e06995ff-c86f-43d5-b402-150f473da0af req-6a41d557-edb6-4cb3-8414-f3e654bf6cfe tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3294489 Dec 20 05:53:38.690809 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d8e56413-b498-4c72-b103-13910d135044 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:38.744473 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-655220bb-5d56-4c02-b31f-f8c83c61275e admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=17cd330dca7248779d2a58d2d5b87fa8&name=default HTTP/1.1" status: 200 len: 2996 time: 2.4749134 Dec 20 05:53:38.748690 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41158) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:38.757270 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Attempting to bind port 04f78e54-1e12-4575-b3c2-165c19e74def on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:53:38.757877 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Attempting to bind port 04f78e54-1e12-4575-b3c2-165c19e74def by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': 'bb43682f-2240-467e-b9ff-f7edf582b7d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': '43c0c2bb-3a2a-478c-b157-c23e2b672361'}] {{(pid=102446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:53:38.758440 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Attempting to bind port 04f78e54-1e12-4575-b3c2-165c19e74def on network 43c0c2bb-3a2a-478c-b157-c23e2b672361 {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:53:38.779564 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Port 04f78e54-1e12-4575-b3c2-165c19e74def on network 43c0c2bb-3a2a-478c-b157-c23e2b672361 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 05:53:38.780370 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Attempting to bind port 04f78e54-1e12-4575-b3c2-165c19e74def on network 43c0c2bb-3a2a-478c-b157-c23e2b672361 {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:53:38.791095 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 53, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:53:38.791866 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Checking segment: {'id': 'bb43682f-2240-467e-b9ff-f7edf582b7d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': '43c0c2bb-3a2a-478c-b157-c23e2b672361'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:53:38.792253 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Bound using segment: {'id': 'bb43682f-2240-467e-b9ff-f7edf582b7d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': '43c0c2bb-3a2a-478c-b157-c23e2b672361'} {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:53:38.793779 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Bound port: 04f78e54-1e12-4575-b3c2-165c19e74def, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bb43682f-2240-467e-b9ff-f7edf582b7d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': '43c0c2bb-3a2a-478c-b157-c23e2b672361'}}] {{(pid=102446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:53:38.794346 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:38.811432 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-47c4e0d8-3dc4-4aac-99e5-3dbc210b81c1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=1898b7c1b3dc4523b09a97486622c67e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2534120 Dec 20 05:53:38.854829 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d8e56413-b498-4c72-b103-13910d135044 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:38.871563 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4f95cbc9-766f-4ab1-8b9e-7e634adba778 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:38.918041 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4f95cbc9-766f-4ab1-8b9e-7e634adba778 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:38.974553 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] For port 04f78e54-1e12-4575-b3c2-165c19e74def, host hv-cinder-82227, cleared binding levels {{(pid=102446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:53:39.021322 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] For port 04f78e54-1e12-4575-b3c2-165c19e74def, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=04f78e54-1e12-4575-b3c2-165c19e74def,segment=NetworkSegment(bb43682f-2240-467e-b9ff-f7edf582b7d1),segment_id=bb43682f-2240-467e-b9ff-f7edf582b7d1)] {{(pid=102446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:53:39.038953 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:39.061658 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d8e56413-b498-4c72-b103-13910d135044 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:39.064612 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d8e56413-b498-4c72-b103-13910d135044 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:39.065949 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-d8e56413-b498-4c72-b103-13910d135044 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/a5d5632e-0ee6-46c0-89c2-92a2806461c7 HTTP/1.1" status: 204 len: 168 time: 0.7130203 Dec 20 05:53:39.084129 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8e56413-b498-4c72-b103-13910d135044 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a5d5632e-0ee6-46c0-89c2-92a2806461c7,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:39.099824 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-908ae12a-dc4e-43a4-8e39-71c709752ff4 service neutron] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 05:53:39.106193 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-908ae12a-dc4e-43a4-8e39-71c709752ff4 service neutron] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1265633 Dec 20 05:53:39.152219 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4f95cbc9-766f-4ab1-8b9e-7e634adba778 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:39.154834 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4f95cbc9-766f-4ab1-8b9e-7e634adba778 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:39.156609 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-4f95cbc9-766f-4ab1-8b9e-7e634adba778 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/da0d92d1-7098-4312-b08d-71b04ede546d HTTP/1.1" status: 204 len: 168 time: 0.4062943 Dec 20 05:53:39.187399 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f95cbc9-766f-4ab1-8b9e-7e634adba778 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da0d92d1-7098-4312-b08d-71b04ede546d,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:39.191300 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:39.192308 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:39.194149 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] 10.222.0.54 "PUT /v2.0/ports/04f78e54-1e12-4575-b3c2-165c19e74def HTTP/1.1" status: 200 len: 1093 time: 3.2385323 Dec 20 05:53:39.194739 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3c23e2c6-db4c-4766-8571-6e612c92168e', 'tag': '04f78e54-1e12-4575-b3c2-165c19e74def'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:53:39.287028 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd682ff0-9e7e-4b45-a1c5-e67aa12addb8 service neutron] Pushing event updated for resources: {'Port': ['ID=04f78e54-1e12-4575-b3c2-165c19e74def,revision_number=3']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:39.403019 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-d1c6e3cc-735b-4a25-a664-48c733d3815e service neutron] 10.222.0.46 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2918322 Dec 20 05:53:39.528293 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-54757ff4-0b74-419a-a924-61e0b91ea13d service neutron] 10.222.0.46 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1236501 Dec 20 05:53:39.639185 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41198) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:39.658063 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-89404957-fbd6-48cf-a1ee-5cdb00bd4c06 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:39.674504 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-71dd721d-0bba-4bec-abe5-d20875caa37b" -d '{"events": [{"name": "network-changed", "server_uuid": "3c23e2c6-db4c-4766-8571-6e612c92168e", "tag": "04f78e54-1e12-4575-b3c2-165c19e74def"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:53:39.830799 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abae7ce7-24e5-4962-98b0-ddf4e9b5b31d req-a6d45153-4441-4476-9842-7a81b2738230 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:39.831469 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-89404957-fbd6-48cf-a1ee-5cdb00bd4c06 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:39.833324 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-abae7ce7-24e5-4962-98b0-ddf4e9b5b31d req-a6d45153-4441-4476-9842-7a81b2738230 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 943 time: 0.0681171 Dec 20 05:53:39.838156 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-89404957-fbd6-48cf-a1ee-5cdb00bd4c06 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:39.876099 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-89404957-fbd6-48cf-a1ee-5cdb00bd4c06 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=45c437fb779646b5bac07841b5f697c4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2344573 Dec 20 05:53:39.878449 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41226) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:39.929753 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89404957-fbd6-48cf-a1ee-5cdb00bd4c06 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=00a508f9-517a-491c-9070-c884caa82a10,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:39.937043 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-abae7ce7-24e5-4962-98b0-ddf4e9b5b31d req-cc30a801-d15d-48c4-ad0a-0f74b293b219 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0961199 Dec 20 05:53:39.970437 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c3dbc260-479a-49b9-8ae7-39521457b96d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:39.994572 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c3dbc260-479a-49b9-8ae7-39521457b96d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:40.053588 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c3dbc260-479a-49b9-8ae7-39521457b96d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:40.060492 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c3dbc260-479a-49b9-8ae7-39521457b96d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:40.062437 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-c3dbc260-479a-49b9-8ae7-39521457b96d admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/00a508f9-517a-491c-9070-c884caa82a10 HTTP/1.1" status: 204 len: 168 time: 0.1825595 Dec 20 05:53:40.075270 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3dbc260-479a-49b9-8ae7-39521457b96d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=00a508f9-517a-491c-9070-c884caa82a10,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:40.121102 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8b8e7c79-d0f6-43fb-97fa-e01e835d0449 req-abb6b144-913f-4bda-83c8-c8e74cf51997 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 210 time: 0.0985327 Dec 20 05:53:40.129636 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:53:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b042d337-ddb6-46c2-a6b2-a942a30edcc7 x-openstack-request-id: req-b042d337-ddb6-46c2-a6b2-a942a30edcc7 {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:53:40.129636 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3c23e2c6-db4c-4766-8571-6e612c92168e", "tag": "04f78e54-1e12-4575-b3c2-165c19e74def", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:53:40.129827 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-b042d337-ddb6-46c2-a6b2-a942a30edcc7 {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:53:40.130321 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3c23e2c6-db4c-4766-8571-6e612c92168e', 'tag': '04f78e54-1e12-4575-b3c2-165c19e74def', 'status': 'completed', 'code': 200} Dec 20 05:53:40.174944 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41248) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:40.426771 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4d0b2f9b-3ad4-451b-909b-ddeafc6afe2f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:40.624563 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4d0b2f9b-3ad4-451b-909b-ddeafc6afe2f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:40.633062 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4d0b2f9b-3ad4-451b-909b-ddeafc6afe2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:40.692864 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d0b2f9b-3ad4-451b-909b-ddeafc6afe2f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a3eeadc-2879-4a23-b4b2-68ccfdec4acc,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:40.700231 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-4d0b2f9b-3ad4-451b-909b-ddeafc6afe2f admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=0857ff28cd8345de92350113918b6d9c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5242047 Dec 20 05:53:40.700418 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41284) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:40.830612 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-91f8b6df-7b37-449e-b87e-4c8f0f0db7f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:40.884320 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-91f8b6df-7b37-449e-b87e-4c8f0f0db7f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:40.892941 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41290) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:41.007000 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-91f8b6df-7b37-449e-b87e-4c8f0f0db7f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:41.014678 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-91f8b6df-7b37-449e-b87e-4c8f0f0db7f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:41.014678 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-91f8b6df-7b37-449e-b87e-4c8f0f0db7f6 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/2a3eeadc-2879-4a23-b4b2-68ccfdec4acc HTTP/1.1" status: 204 len: 168 time: 0.3104281 Dec 20 05:53:41.028805 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91f8b6df-7b37-449e-b87e-4c8f0f0db7f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a3eeadc-2879-4a23-b4b2-68ccfdec4acc,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:41.101720 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-616098513-network', 'tenant_id': '18ac128ce2074d239413c5e1ccfc5243'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:41.132485 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48750324-7f2d-4481-af3d-f49a58bdd49c req-dbcf23e4-d5fc-4058-8171-81f0fcf970b3 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:41.156329 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-48750324-7f2d-4481-af3d-f49a58bdd49c req-dbcf23e4-d5fc-4058-8171-81f0fcf970b3 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 943 time: 0.1098046 Dec 20 05:53:41.192929 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] Made reservation on behalf of 18ac128ce2074d239413c5e1ccfc5243 for: {'network': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:53:41.205517 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:41.238087 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:41.281705 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-48750324-7f2d-4481-af3d-f49a58bdd49c req-6236fdd7-514e-4fce-a9ed-f4a0775c1455 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1240005 Dec 20 05:53:41.498301 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:41.506193 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:41.508656 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6efb53a7-19bd-4929-8b35-7637d696d282 req-38631443-7202-4b3c-8f78-0f198ceaf9ab tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 210 time: 0.0530183 Dec 20 05:53:41.585015 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] vlan segment allocate from pool success with {'vlan_id': 402, 'physical_network': 'physnet1'} {{(pid=102446) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:53:41.640468 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8dda7c2e-0078-4f6f-9a94-6902f7f0bd32,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:41.652279 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:41.652522 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.segments_db [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] Added segment bd993846-0533-431f-9111-3c1b89dd9862 of type vlan for network 75182876-f0f0-47a5-827e-e6712214b73f Dec 20 05:53:41.797688 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:41.830778 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41338) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:41.857066 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:41.858432 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:41.859876 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:41.871296 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-c89ecff4-4e04-4869-8ab3-9fea410d31c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:42.037575 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 1.1432474 Dec 20 05:53:42.038783 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41356) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:42.046205 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-8420d2bb-2a8c-4407-b9d0-693ae55d001e admin admin] Request body: {'subnet': {'network_id': '75182876-f0f0-47a5-827e-e6712214b73f', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-616098513-subnet', 'tenant_id': '18ac128ce2074d239413c5e1ccfc5243', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:42.052401 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ae0642-1138-4cb2-9402-91d1a2a54497 admin admin] Pushing event updated for resources: {'Network': ['ID=75182876-f0f0-47a5-827e-e6712214b73f,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:42.064881 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network 75182876-f0f0-47a5-827e-e6712214b73f details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:53:42.112275 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8420d2bb-2a8c-4407-b9d0-693ae55d001e admin admin] Made reservation on behalf of 18ac128ce2074d239413c5e1ccfc5243 for: {'subnet': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:53:42.116427 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8420d2bb-2a8c-4407-b9d0-693ae55d001e admin admin] Publish callbacks [] for subnet, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:42.143959 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-c89ecff4-4e04-4869-8ab3-9fea410d31c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:42.151410 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-c89ecff4-4e04-4869-8ab3-9fea410d31c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:42.227235 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-c89ecff4-4e04-4869-8ab3-9fea410d31c2 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=312d7e4e57e84849a392b94331480930&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3952229 Dec 20 05:53:42.230699 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41366) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:42.241701 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c89ecff4-4e04-4869-8ab3-9fea410d31c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=93cb2cc5-4713-446c-af82-0da07ee4c440,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:42.557265 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-06d929e7-5fb5-4b17-b6c2-cd41ae7495ee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:42.594770 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-06d929e7-5fb5-4b17-b6c2-cd41ae7495ee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:42.669532 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-06d929e7-5fb5-4b17-b6c2-cd41ae7495ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:42.672455 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-06d929e7-5fb5-4b17-b6c2-cd41ae7495ee admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:42.673777 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-06d929e7-5fb5-4b17-b6c2-cd41ae7495ee admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/93cb2cc5-4713-446c-af82-0da07ee4c440 HTTP/1.1" status: 204 len: 168 time: 0.4419975 Dec 20 05:53:42.721249 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aa13884-6429-4d92-8f98-365f88e57179 req-0eab403b-9aae-4eb1-a463-e7c34ed0154e tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:42.723165 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1aa13884-6429-4d92-8f98-365f88e57179 req-0eab403b-9aae-4eb1-a463-e7c34ed0154e tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 943 time: 0.3330116 Dec 20 05:53:42.759176 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1dabc3ba-cf59-4578-9f1a-4fe379d3085f req-a5811ee6-4794-402e-905e-8e9e26246a71 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 210 time: 0.0833673 Dec 20 05:53:42.765965 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06d929e7-5fb5-4b17-b6c2-cd41ae7495ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93cb2cc5-4713-446c-af82-0da07ee4c440,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:42.803163 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8420d2bb-2a8c-4407-b9d0-693ae55d001e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for subnet, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:42.899320 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1aa13884-6429-4d92-8f98-365f88e57179 req-75a04df9-2586-4646-9324-6c369209a1be tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1387994 Dec 20 05:53:42.905337 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8420d2bb-2a8c-4407-b9d0-693ae55d001e admin admin] Pushing event updated for resources: {'Subnet': ['ID=6f5b022c-6f2a-40bd-9ae1-1c5b0ef1e55c,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:42.911622 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8420d2bb-2a8c-4407-b9d0-693ae55d001e admin admin] Checking segment: {'id': 'bd993846-0533-431f-9111-3c1b89dd9862', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': '75182876-f0f0-47a5-827e-e6712214b73f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:53:42.912041 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8420d2bb-2a8c-4407-b9d0-693ae55d001e admin admin] Network hostable DHCP agents. Network: 75182876-f0f0-47a5-827e-e6712214b73f, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:53:42.961531 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8420d2bb-2a8c-4407-b9d0-693ae55d001e admin admin] Network 75182876-f0f0-47a5-827e-e6712214b73f is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:53:42.988401 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-8420d2bb-2a8c-4407-b9d0-693ae55d001e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, 75182876-f0f0-47a5-827e-e6712214b73f) {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:53:42.997249 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0672a658-5fe9-4283-a915-8306b4b8c01a None None] Network 75182876-f0f0-47a5-827e-e6712214b73f requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:53:43.010448 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8420d2bb-2a8c-4407-b9d0-693ae55d001e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:43.012645 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8420d2bb-2a8c-4407-b9d0-693ae55d001e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:43.047445 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-8420d2bb-2a8c-4407-b9d0-693ae55d001e admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 1.0057476 Dec 20 05:53:43.218423 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64ad3ba6-1bc4-462a-a7e0-ae0fa9dea115 None None] Network 75182876-f0f0-47a5-827e-e6712214b73f requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:53:43.987306 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fc4f76f0-06c8-4bab-b7c1-c8d8760ba464 req-5e6997fe-8d11-4bca-8fc4-006f4595ccf1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 210 time: 0.0951059 Dec 20 05:53:43.998498 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41448) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:44.142021 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec1088d-eec0-44e4-8a81-d2cf9223e1e6 req-226a8a2f-2e25-4399-a36c-2638b1806d1d tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:44.143864 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dec1088d-eec0-44e4-8a81-d2cf9223e1e6 req-226a8a2f-2e25-4399-a36c-2638b1806d1d tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 943 time: 0.1016669 Dec 20 05:53:44.210365 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dec1088d-eec0-44e4-8a81-d2cf9223e1e6 req-6da8911c-184a-4ce9-8536-bd677768823f tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595701 Dec 20 05:53:44.306561 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d4741bb2-b123-4cf0-bfbe-2e267487bd62 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:44.416746 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d4741bb2-b123-4cf0-bfbe-2e267487bd62 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:44.424548 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d4741bb2-b123-4cf0-bfbe-2e267487bd62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:44.597056 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-d4741bb2-b123-4cf0-bfbe-2e267487bd62 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=bfe02061002a44828d4127c4a8547de1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5968902 Dec 20 05:53:44.597410 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41472) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:44.598042 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4741bb2-b123-4cf0-bfbe-2e267487bd62 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c034b77a-ccb8-4413-a455-361a4553fbff,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:44.682091 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0cae28dd-a120-4464-9252-65fff12f2993 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:44.723908 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0cae28dd-a120-4464-9252-65fff12f2993 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:44.845779 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0cae28dd-a120-4464-9252-65fff12f2993 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:44.848860 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0cae28dd-a120-4464-9252-65fff12f2993 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:44.851671 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-0cae28dd-a120-4464-9252-65fff12f2993 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/c034b77a-ccb8-4413-a455-361a4553fbff HTTP/1.1" status: 204 len: 168 time: 0.2497683 Dec 20 05:53:44.861168 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cae28dd-a120-4464-9252-65fff12f2993 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c034b77a-ccb8-4413-a455-361a4553fbff,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:44.933204 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41482) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:44.939645 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-778040936-network', 'tenant_id': '99708d316770420cb39fb868b8cfa108'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:44.987758 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] Made reservation on behalf of 99708d316770420cb39fb868b8cfa108 for: {'network': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:53:44.992189 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:45.030621 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:45.210531 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:45.216751 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:45.232923 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-28592125-2143-4a7a-8f54-df27180d86bc req-c0e00d4c-6d78-45c2-a95f-92fc486b338c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 210 time: 0.1037447 Dec 20 05:53:45.281038 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] vlan segment allocate from pool success with {'vlan_id': 412, 'physical_network': 'physnet1'} {{(pid=102446) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:53:45.291505 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a73a52c3-f853-4ca0-8d8c-6a553d0eb138,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:45.313476 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:45.313933 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.segments_db [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] Added segment 1ec43640-46e8-4e1c-9ed3-1ff416dd1237 of type vlan for network 282d0414-d13c-49dd-be20-33c672fbd9f4 Dec 20 05:53:45.429409 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:45.495780 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:45.497427 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:45.498815 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:45.527048 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-100361cf-6891-480e-9d38-484947b5f304 req-b2946b68-9b27-4975-800a-046f21e9d3e5 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:45.537777 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-100361cf-6891-480e-9d38-484947b5f304 req-b2946b68-9b27-4975-800a-046f21e9d3e5 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 943 time: 0.1412566 Dec 20 05:53:45.548295 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.6137435 Dec 20 05:53:45.551839 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41516) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:45.560511 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41518) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:45.569374 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-f924757f-0bda-4c11-84ad-bc83ce3b36b2 admin admin] Request body: {'subnet': {'network_id': '282d0414-d13c-49dd-be20-33c672fbd9f4', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-778040936-subnet', 'tenant_id': '99708d316770420cb39fb868b8cfa108', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:45.590821 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-635a36ba-f0e2-4af2-b0c5-3aa7b51b1c26 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:45.650850 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03df2327-3c3b-4b56-848e-6592ada13266 admin admin] Pushing event updated for resources: {'Network': ['ID=282d0414-d13c-49dd-be20-33c672fbd9f4,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:45.662609 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network 282d0414-d13c-49dd-be20-33c672fbd9f4 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:53:45.678889 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f924757f-0bda-4c11-84ad-bc83ce3b36b2 admin admin] Made reservation on behalf of 99708d316770420cb39fb868b8cfa108 for: {'subnet': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:53:45.681904 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f924757f-0bda-4c11-84ad-bc83ce3b36b2 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:45.686888 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-100361cf-6891-480e-9d38-484947b5f304 req-dce6fb03-d3a1-4c12-a063-c8e727a9f560 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1375635 Dec 20 05:53:45.828589 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-635a36ba-f0e2-4af2-b0c5-3aa7b51b1c26 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:45.839895 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-635a36ba-f0e2-4af2-b0c5-3aa7b51b1c26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:45.895385 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-635a36ba-f0e2-4af2-b0c5-3aa7b51b1c26 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=966fdc3406bb418e8e6aa46346a35cb4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3337297 Dec 20 05:53:45.897505 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-635a36ba-f0e2-4af2-b0c5-3aa7b51b1c26 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=00272e93-4d26-4d74-bb44-029a06328f7f,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:45.901109 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41530) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:45.982201 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f924757f-0bda-4c11-84ad-bc83ce3b36b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for subnet, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:45.990704 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fcf08ccf-b672-4378-ac12-87824a019e99 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:46.037203 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f924757f-0bda-4c11-84ad-bc83ce3b36b2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ebb9a0f4-27fe-49df-83e0-198302349a04,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:46.053776 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fcf08ccf-b672-4378-ac12-87824a019e99 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:46.079888 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f924757f-0bda-4c11-84ad-bc83ce3b36b2 admin admin] Checking segment: {'id': '1ec43640-46e8-4e1c-9ed3-1ff416dd1237', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '282d0414-d13c-49dd-be20-33c672fbd9f4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:53:46.081390 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f924757f-0bda-4c11-84ad-bc83ce3b36b2 admin admin] Network hostable DHCP agents. Network: 282d0414-d13c-49dd-be20-33c672fbd9f4, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102446) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:53:46.104934 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f924757f-0bda-4c11-84ad-bc83ce3b36b2 admin admin] Network 282d0414-d13c-49dd-be20-33c672fbd9f4 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102446) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:53:46.128046 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-f924757f-0bda-4c11-84ad-bc83ce3b36b2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, 282d0414-d13c-49dd-be20-33c672fbd9f4) {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:53:46.151378 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0e2493a-2b8f-4f72-990a-71f4fb080c93 None None] Network 282d0414-d13c-49dd-be20-33c672fbd9f4 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:53:46.154505 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f924757f-0bda-4c11-84ad-bc83ce3b36b2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:46.155467 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f924757f-0bda-4c11-84ad-bc83ce3b36b2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:46.175955 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fcf08ccf-b672-4378-ac12-87824a019e99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:46.188294 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-f924757f-0bda-4c11-84ad-bc83ce3b36b2 admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 0.6336927 Dec 20 05:53:46.200927 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fcf08ccf-b672-4378-ac12-87824a019e99 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:46.201619 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-fcf08ccf-b672-4378-ac12-87824a019e99 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/00272e93-4d26-4d74-bb44-029a06328f7f HTTP/1.1" status: 204 len: 168 time: 0.2994807 Dec 20 05:53:46.202328 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41540) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:46.218661 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcf08ccf-b672-4378-ac12-87824a019e99 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=00272e93-4d26-4d74-bb44-029a06328f7f,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:46.253892 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41546) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:46.410389 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41554) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:46.425312 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e034db71-53df-4fe8-8626-5dc236275be7 None None] Network 282d0414-d13c-49dd-be20-33c672fbd9f4 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:53:46.425845 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2dab5ca8-6666-4761-9fcb-ba68492d0223 req-65fa814c-2b82-4865-b4d8-8153505df879 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 210 time: 0.0649805 Dec 20 05:53:46.483609 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_v2 [None req-064809ed-a3ea-46c5-b377-436b8e05e021 admin admin] Deleting subnet 6f5b022c-6f2a-40bd-9ae1-1c5b0ef1e55c {{(pid=102446) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 05:53:46.489033 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-064809ed-a3ea-46c5-b377-436b8e05e021 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:46.587278 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-064809ed-a3ea-46c5-b377-436b8e05e021 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:46.622281 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-064809ed-a3ea-46c5-b377-436b8e05e021 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:46.774066 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-064809ed-a3ea-46c5-b377-436b8e05e021 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for subnet, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:46.856549 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9367efa7-f302-4ac7-b470-3b7678a3eade admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:46.925154 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-064809ed-a3ea-46c5-b377-436b8e05e021 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:46.933735 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-064809ed-a3ea-46c5-b377-436b8e05e021 admin admin] 10.222.0.46 "DELETE /v2.0/subnets/6f5b022c-6f2a-40bd-9ae1-1c5b0ef1e55c HTTP/1.1" status: 204 len: 168 time: 0.5214076 Dec 20 05:53:46.945882 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d964577-7f85-4e91-9be2-dfd4b52041c2 req-abfc6ec8-099b-42ff-98b2-358291ec1156 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:46.956316 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8d964577-7f85-4e91-9be2-dfd4b52041c2 req-abfc6ec8-099b-42ff-98b2-358291ec1156 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 943 time: 0.1367347 Dec 20 05:53:46.958527 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41572) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:46.972820 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-064809ed-a3ea-46c5-b377-436b8e05e021 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6f5b022c-6f2a-40bd-9ae1-1c5b0ef1e55c,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:47.163499 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9367efa7-f302-4ac7-b470-3b7678a3eade admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.166819 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a59b6ddf-08db-492d-ae3e-8dcbb4523af2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.172532 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8d964577-7f85-4e91-9be2-dfd4b52041c2 req-9853bfc9-9966-4c29-b035-d0d884f8127c tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2124348 Dec 20 05:53:47.179029 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9367efa7-f302-4ac7-b470-3b7678a3eade admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.182775 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.274301 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-9367efa7-f302-4ac7-b470-3b7678a3eade admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=b4c14235a7e4470b8d42cf09992e61af&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0703866 Dec 20 05:53:47.277882 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41588) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:47.316903 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9367efa7-f302-4ac7-b470-3b7678a3eade admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b0094d6-c95b-4616-ba05-53b53cce2d9d,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:47.384497 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-345ae84f-b4c8-4232-a3f0-84907f9d7431 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.424817 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-345ae84f-b4c8-4232-a3f0-84907f9d7431 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.435382 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a59b6ddf-08db-492d-ae3e-8dcbb4523af2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.442694 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a59b6ddf-08db-492d-ae3e-8dcbb4523af2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.477200 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-a59b6ddf-08db-492d-ae3e-8dcbb4523af2 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=43c32ee858fb49039fc28516bde8885f&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2218096 Dec 20 05:53:47.477841 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41598) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:47.501229 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.528413 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a59b6ddf-08db-492d-ae3e-8dcbb4523af2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa971e30-68dc-4533-9d0f-0b822d2e8272,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:47.568116 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2480ad40-5b42-411a-93f5-14c8f97b5284 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.590492 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-345ae84f-b4c8-4232-a3f0-84907f9d7431 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.593945 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-345ae84f-b4c8-4232-a3f0-84907f9d7431 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.594709 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:47.595220 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:47.596621 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:47.596790 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Subscribe: > port after_create 55550000 {{(pid=102445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:47.597109 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Subscribe: > port after_delete 55550000 {{(pid=102445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:47.597374 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Subscribe: > port after_update 55550000 {{(pid=102445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:47.597696 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:47.598293 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-345ae84f-b4c8-4232-a3f0-84907f9d7431 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/0b0094d6-c95b-4616-ba05-53b53cce2d9d HTTP/1.1" status: 204 len: 168 time: 0.3181500 Dec 20 05:53:47.602809 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:47.603296 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:47.603927 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:47.604799 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2480ad40-5b42-411a-93f5-14c8f97b5284 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.617881 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-345ae84f-b4c8-4232-a3f0-84907f9d7431 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b0094d6-c95b-4616-ba05-53b53cce2d9d,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:47.715051 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2480ad40-5b42-411a-93f5-14c8f97b5284 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.718476 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2480ad40-5b42-411a-93f5-14c8f97b5284 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:47.720471 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-2480ad40-5b42-411a-93f5-14c8f97b5284 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/aa971e30-68dc-4533-9d0f-0b822d2e8272 HTTP/1.1" status: 204 len: 168 time: 0.2388456 Dec 20 05:53:47.730149 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2480ad40-5b42-411a-93f5-14c8f97b5284 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa971e30-68dc-4533-9d0f-0b822d2e8272,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:47.921755 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:47.922127 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:47.922513 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:47.922870 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:47.923257 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['75182876-f0f0-47a5-827e-e6712214b73f']}} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:53:47.956777 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bd993846-0533-431f-9111-3c1b89dd9862') {'for_net_delete': True} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:53:47.956992 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bd993846-0533-431f-9111-3c1b89dd9862') {} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:53:47.982064 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-100047c2-210b-4599-92a1-026e6f43e20b req-97133c58-0634-42e1-9fcc-52cd6920a681 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 210 time: 0.0493729 Dec 20 05:53:47.987418 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3457718'] for segment, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.011834 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.021938 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Releasing vlan 402 on physical network physnet1 to pool {{(pid=102445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 05:53:48.022768 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3465205'] for segment, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: from cryptography.utils import int_from_bytes Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: from cryptography.utils import int_from_bytes Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: Traceback (most recent call last): Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: timer() Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: cb(*args, **kw) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: return func(*args, **kwargs) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: self._notify() Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: self.callback(batched_events) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: event.method(event) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: return f(self, *a, **k) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._get(url).json() Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: return self.request(url, 'GET', **kwargs) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 05:53:48.028948 dv-cinder-822278-1-iscsi neutron-server[102445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 05:53:48.096501 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.104660 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.111798 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] 10.222.0.46 "DELETE /v2.0/networks/75182876-f0f0-47a5-827e-e6712214b73f HTTP/1.1" status: 204 len: 168 time: 1.1415045 Dec 20 05:53:48.112229 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41622) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:48.123481 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfdf0058-156d-4ca6-a43f-62b57bef7d70 admin admin] Pushing event deleted for resources: {'Network': ['ID=75182876-f0f0-47a5-827e-e6712214b73f,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:48.160471 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41626) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:48.249021 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_v2 [None req-c7053110-e764-45c5-9b3d-4b6e85f090ee admin admin] Deleting subnet ebb9a0f4-27fe-49df-83e0-198302349a04 {{(pid=102446) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 05:53:48.254367 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c7053110-e764-45c5-9b3d-4b6e85f090ee admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.279275 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41636) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:48.335779 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71dd721d-0bba-4bec-abe5-d20875caa37b req-811002c6-e4e6-4a02-82da-cc8775663b6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:48.337056 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-71dd721d-0bba-4bec-abe5-d20875caa37b req-811002c6-e4e6-4a02-82da-cc8775663b6e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2ffd6c4703134e94b747f03bda57e076&device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 1096 time: 0.1662462 Dec 20 05:53:48.338088 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-af2fdbec-2518-4c42-b429-5685a00a42ed admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.357903 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c7053110-e764-45c5-9b3d-4b6e85f090ee admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.370256 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c7053110-e764-45c5-9b3d-4b6e85f090ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.416312 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757f989a-93b4-4297-8032-285f172954d6 req-bacfbe39-029e-4462-b00f-6fcceba6bdea tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:48.417935 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-757f989a-93b4-4297-8032-285f172954d6 req-bacfbe39-029e-4462-b00f-6fcceba6bdea tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 943 time: 0.1362648 Dec 20 05:53:48.600548 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41648) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:48.619951 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-757f989a-93b4-4297-8032-285f172954d6 req-2fc33bdd-b2c2-4fb4-9e67-af79774e73e6 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1912155 Dec 20 05:53:48.628712 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-73b63c73-9a7c-47ee-83d9-ef2bbd7bddcd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.656331 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-23308c13-cf9b-408d-b6c7-a9cdca9ea629 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.692977 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-af2fdbec-2518-4c42-b429-5685a00a42ed admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.713925 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-af2fdbec-2518-4c42-b429-5685a00a42ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.823554 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-af2fdbec-2518-4c42-b429-5685a00a42ed admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=d5716c91fea34f7ba29e6e0a6bfb7b36&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5429254 Dec 20 05:53:48.826589 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41660) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:48.838048 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af2fdbec-2518-4c42-b429-5685a00a42ed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=12e1a358-5518-49d8-be75-c796c23c0faa,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:48.859473 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c7053110-e764-45c5-9b3d-4b6e85f090ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for subnet, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.885950 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-73b63c73-9a7c-47ee-83d9-ef2bbd7bddcd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.895191 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-73b63c73-9a7c-47ee-83d9-ef2bbd7bddcd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.915875 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7053110-e764-45c5-9b3d-4b6e85f090ee admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ebb9a0f4-27fe-49df-83e0-198302349a04,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:48.918950 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c7053110-e764-45c5-9b3d-4b6e85f090ee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.925324 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-c7053110-e764-45c5-9b3d-4b6e85f090ee admin admin] 10.222.0.46 "DELETE /v2.0/subnets/ebb9a0f4-27fe-49df-83e0-198302349a04 HTTP/1.1" status: 204 len: 168 time: 0.8091760 Dec 20 05:53:48.925429 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73b63c73-9a7c-47ee-83d9-ef2bbd7bddcd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ca3d7f6-d520-4507-895a-dc7d0fba015c,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:48.927964 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41662) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:48.940945 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71dd721d-0bba-4bec-abe5-d20875caa37b req-62640e1b-771f-4ba2-95ad-9b5eaec07411 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:48.942920 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-71dd721d-0bba-4bec-abe5-d20875caa37b req-62640e1b-771f-4ba2-95ad-9b5eaec07411 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=2ffd6c4703134e94b747f03bda57e076&shared=False HTTP/1.1" status: 200 len: 913 time: 0.4748170 Dec 20 05:53:48.974155 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-23308c13-cf9b-408d-b6c7-a9cdca9ea629 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:48.984820 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-73b63c73-9a7c-47ee-83d9-ef2bbd7bddcd admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=adaf04e5ec474fd6bf5a8c33faecfadf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8224041 Dec 20 05:53:48.990322 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41666) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:48.993204 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-23308c13-cf9b-408d-b6c7-a9cdca9ea629 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.028680 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-23308c13-cf9b-408d-b6c7-a9cdca9ea629 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=b62dd1880176412cb5b7b7387c21bcc3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4270096 Dec 20 05:53:49.032697 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41672) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:49.052078 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.54', 56761) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:49.125948 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23308c13-cf9b-408d-b6c7-a9cdca9ea629 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b450ec38-d53f-4e47-b8c6-e7b572e231fb,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:49.136379 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-38f879d9-cd43-4464-8d43-9462a4097c62 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.174147 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.195387 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5a704045-dd58-4c55-9d13-4eeb93b708eb req-ed3a0de5-7847-4e11-bd4f-2c82cc3c73bc tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 210 time: 0.0864255 Dec 20 05:53:49.247170 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71dd721d-0bba-4bec-abe5-d20875caa37b req-a43f0fbb-1541-49b8-af92-eac5b9e560eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:49.248764 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-71dd721d-0bba-4bec-abe5-d20875caa37b req-a43f0fbb-1541-49b8-af92-eac5b9e560eb service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2884004 Dec 20 05:53:49.256934 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-38f879d9-cd43-4464-8d43-9462a4097c62 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.282671 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-18eede6e-f592-4074-a887-ba64a6c4674d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.288275 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-63ae408f-6bb2-44f0-8733-5af89b93f654 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.339023 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-0bb2ba6f-caf5-4cb1-a663-966f5f2e83fc tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:49.346841 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-0bb2ba6f-caf5-4cb1-a663-966f5f2e83fc tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.54 "GET /v2.0/networks?id=6924a88e-10c1-4073-a41c-88aad14ebd0f HTTP/1.1" status: 200 len: 811 time: 0.2877233 Dec 20 05:53:49.346841 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-18eede6e-f592-4074-a887-ba64a6c4674d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.364020 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-63ae408f-6bb2-44f0-8733-5af89b93f654 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.455704 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-18eede6e-f592-4074-a887-ba64a6c4674d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.458457 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-18eede6e-f592-4074-a887-ba64a6c4674d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.470440 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-18eede6e-f592-4074-a887-ba64a6c4674d admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/b450ec38-d53f-4e47-b8c6-e7b572e231fb HTTP/1.1" status: 204 len: 168 time: 0.4298067 Dec 20 05:53:49.487900 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18eede6e-f592-4074-a887-ba64a6c4674d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b450ec38-d53f-4e47-b8c6-e7b572e231fb,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:49.502204 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.515860 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-54159520-ca42-4d7c-9f89-5df09082b83f tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1898b7c1b3dc4523b09a97486622c67e HTTP/1.1" status: 200 len: 379 time: 0.1341000 Dec 20 05:53:49.531886 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-adeb1dfc-eaef-43a2-b4f9-7db26b10243e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Request body: {'port': {'device_id': 'e81aeaf1-e5dc-482f-b37d-b91f972dc6ff', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'admin_state_up': True, 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'security_groups': ['38e9df07-f897-436d-ac60-fe287113cf14']}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:49.535675 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-38f879d9-cd43-4464-8d43-9462a4097c62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.538486 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-38f879d9-cd43-4464-8d43-9462a4097c62 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.539642 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-38f879d9-cd43-4464-8d43-9462a4097c62 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/12e1a358-5518-49d8-be75-c796c23c0faa HTTP/1.1" status: 204 len: 168 time: 0.7115278 Dec 20 05:53:49.542768 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102446) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:49.543109 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102446) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:49.544450 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102446) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:49.544794 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Subscribe: > port after_create 55550000 {{(pid=102446) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:49.545136 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Subscribe: > port after_delete 55550000 {{(pid=102446) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:49.545447 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Subscribe: > port after_update 55550000 {{(pid=102446) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:49.545935 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102446) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:49.546860 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102446) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:49.547178 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102446) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:49.547544 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102446) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:49.616419 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102446) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:49.616776 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102446) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:49.617121 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102446) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:49.617463 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102446) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 20 05:53:49.617821 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['282d0414-d13c-49dd-be20-33c672fbd9f4']}} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:53:49.649223 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1ec43640-46e8-4e1c-9ed3-1ff416dd1237') {'for_net_delete': True} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:53:49.649964 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1ec43640-46e8-4e1c-9ed3-1ff416dd1237') {} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:53:49.665616 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38f879d9-cd43-4464-8d43-9462a4097c62 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=12e1a358-5518-49d8-be75-c796c23c0faa,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:49.673785 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-a4d93326-85a2-4028-a39b-bd9952f31d96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:49.675391 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-a4d93326-85a2-4028-a39b-bd9952f31d96 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=2ffd6c4703134e94b747f03bda57e076&device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 1096 time: 0.2825632 Dec 20 05:53:49.677511 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8976286'] for segment, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.682791 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-adeb1dfc-eaef-43a2-b4f9-7db26b10243e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Made reservation on behalf of 1898b7c1b3dc4523b09a97486622c67e for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:53:49.688650 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-adeb1dfc-eaef-43a2-b4f9-7db26b10243e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.693350 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-63ae408f-6bb2-44f0-8733-5af89b93f654 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.697467 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-63ae408f-6bb2-44f0-8733-5af89b93f654 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.699744 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-63ae408f-6bb2-44f0-8733-5af89b93f654 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/3ca3d7f6-d520-4507-895a-dc7d0fba015c HTTP/1.1" status: 204 len: 168 time: 0.7065611 Dec 20 05:53:49.785053 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.790804 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63ae408f-6bb2-44f0-8733-5af89b93f654 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ca3d7f6-d520-4507-895a-dc7d0fba015c,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:49.793256 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-59b7632e-214e-41aa-8b7f-42dba4ad0d50 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=04f78e54-1e12-4575-b3c2-165c19e74def HTTP/1.1" status: 200 len: 217 time: 0.0867724 Dec 20 05:53:49.797634 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Releasing vlan 412 on physical network physnet1 to pool {{(pid=102446) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 05:53:49.798199 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9173254'] for segment, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: from cryptography.utils import int_from_bytes Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: from cryptography.utils import int_from_bytes Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: Traceback (most recent call last): Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: timer() Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: cb(*args, **kw) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: return func(*args, **kwargs) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: self._notify() Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: self.callback(batched_events) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: event.method(event) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: return f(self, *a, **k) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._get(url).json() Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: return self.request(url, 'GET', **kwargs) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 05:53:49.802541 dv-cinder-822278-1-iscsi neutron-server[102446]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 05:53:49.913154 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.915422 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-a2435b30-6482-4a41-8724-d134d8e358bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:49.919437 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-a2435b30-6482-4a41-8724-d134d8e358bf service neutron] 10.222.0.54 "GET /v2.0/subnets?id=385e0f7c-479c-4f5c-84eb-a5a7aeba6f4c HTTP/1.1" status: 200 len: 852 time: 0.1022887 Dec 20 05:53:49.922582 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1983c327-16b4-4342-8764-23eb0c67c0a1 req-fbf605db-12e1-4990-9ac4-74d2b6a07546 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:49.924787 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1983c327-16b4-4342-8764-23eb0c67c0a1 req-fbf605db-12e1-4990-9ac4-74d2b6a07546 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 943 time: 0.1927805 Dec 20 05:53:49.947630 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:49.955949 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] 10.222.0.46 "DELETE /v2.0/networks/282d0414-d13c-49dd-be20-33c672fbd9f4 HTTP/1.1" status: 204 len: 168 time: 1.0229671 Dec 20 05:53:50.037719 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5816a92f-a5e7-46e2-9395-2ec2e6147ce5 admin admin] Pushing event deleted for resources: {'Network': ['ID=282d0414-d13c-49dd-be20-33c672fbd9f4,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:50.089841 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-cd01c5b5-5f3c-483b-8f39-5176aaa1bbed service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=43c0c2bb-3a2a-478c-b157-c23e2b672361&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1512065 Dec 20 05:53:50.166982 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41734) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:50.196518 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-adeb1dfc-eaef-43a2-b4f9-7db26b10243e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Allocated IP 172.20.0.8 (6924a88e-10c1-4073-a41c-88aad14ebd0f/ffb588f9-2ffb-4921-8a76-be5179c2fbed/abed4d23-da46-4f59-9f36-c9fc12fcb192) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:53:50.211726 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-721cf8fe-06da-431e-863b-7dd632fad0ee service neutron] 10.222.0.54 "GET /v2.0/networks/43c0c2bb-3a2a-478c-b157-c23e2b672361?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1091204 Dec 20 05:53:50.252440 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1983c327-16b4-4342-8764-23eb0c67c0a1 req-2762ba97-cba4-489f-be7d-5a6baeaa97a7 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3053904 Dec 20 05:53:50.329647 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41746) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:50.336747 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bc5fff58-0fd1-4ba0-86b9-f76bf5f1e0cc req-db15104e-20af-474e-88cc-000467f053ea tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 210 time: 0.0408232 Dec 20 05:53:50.365017 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-90770c51-85e4-474e-8bb6-c8973a85d862 req-05c212a5-9b0f-4c40-8ac6-27f760fd7fb2 service neutron] 10.222.0.54 "GET /v2.0/networks/43c0c2bb-3a2a-478c-b157-c23e2b672361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1443636 Dec 20 05:53:50.397983 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-e21eb1a1-9d88-4e62-bcbb-0178d5fb5774 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=18ac128ce2074d239413c5e1ccfc5243&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0622637 Dec 20 05:53:50.397983 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41748) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:50.451534 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41750) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:50.455843 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-adeb1dfc-eaef-43a2-b4f9-7db26b10243e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.471916 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ea851850-6084-44a7-88a9-d61516aacadd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.475691 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d246b2a1-462d-426e-95e5-de77d076c9dc admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.496677 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-adeb1dfc-eaef-43a2-b4f9-7db26b10243e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.509095 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ea851850-6084-44a7-88a9-d61516aacadd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.590189 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ea851850-6084-44a7-88a9-d61516aacadd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.593756 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ea851850-6084-44a7-88a9-d61516aacadd admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.595280 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-ea851850-6084-44a7-88a9-d61516aacadd admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/8dda7c2e-0078-4f6f-9a94-6902f7f0bd32 HTTP/1.1" status: 204 len: 168 time: 0.1987364 Dec 20 05:53:50.611652 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea851850-6084-44a7-88a9-d61516aacadd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8dda7c2e-0078-4f6f-9a94-6902f7f0bd32,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:50.628986 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d246b2a1-462d-426e-95e5-de77d076c9dc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.632073 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-adeb1dfc-eaef-43a2-b4f9-7db26b10243e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Network 6924a88e-10c1-4073-a41c-88aad14ebd0f is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:53:50.636417 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d246b2a1-462d-426e-95e5-de77d076c9dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.639264 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-adeb1dfc-eaef-43a2-b4f9-7db26b10243e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:53:50.641894 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adeb1dfc-eaef-43a2-b4f9-7db26b10243e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event updated for resources: {'Port': ['ID=abed4d23-da46-4f59-9f36-c9fc12fcb192,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:50.654897 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-adeb1dfc-eaef-43a2-b4f9-7db26b10243e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:53:50.709980 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-d246b2a1-462d-426e-95e5-de77d076c9dc admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=f4ee5687ca2844a1aef4ac48ab025a14&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2573676 Dec 20 05:53:50.710762 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d246b2a1-462d-426e-95e5-de77d076c9dc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb36a2e5-86dd-4703-a65f-751437d496a1,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:50.713132 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41758) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:50.758425 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cd542dc9-8a4c-4638-807c-4651fba1be93 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.761799 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-adeb1dfc-eaef-43a2-b4f9-7db26b10243e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:50.762550 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-adeb1dfc-eaef-43a2-b4f9-7db26b10243e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.780616 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-adeb1dfc-eaef-43a2-b4f9-7db26b10243e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2563434 Dec 20 05:53:50.805530 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Request body: {'port': {'device_id': 'e81aeaf1-e5dc-482f-b37d-b91f972dc6ff', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:50.807688 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1059d045-00b1-4be3-b443-05eeffb811d9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.857327 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1059d045-00b1-4be3-b443-05eeffb811d9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.886004 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.952241 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cd542dc9-8a4c-4638-807c-4651fba1be93 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.959384 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cd542dc9-8a4c-4638-807c-4651fba1be93 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.980306 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1059d045-00b1-4be3-b443-05eeffb811d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.982882 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1059d045-00b1-4be3-b443-05eeffb811d9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:50.987001 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-1059d045-00b1-4be3-b443-05eeffb811d9 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/cb36a2e5-86dd-4703-a65f-751437d496a1 HTTP/1.1" status: 204 len: 168 time: 0.2729206 Dec 20 05:53:51.011792 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-cd542dc9-8a4c-4638-807c-4651fba1be93 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=5abb7ea93a784aba91f782f865bcad55&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8437257 Dec 20 05:53:51.013003 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd542dc9-8a4c-4638-807c-4651fba1be93 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4cf1e884-71d7-4737-9008-2c5887ebfb7a,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:51.015628 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41770) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:51.022193 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-e44007e6-0b37-46f8-9a01-e1d3a7d5d110 None None] Provisioning complete for port abed4d23-da46-4f59-9f36-c9fc12fcb192 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:53:51.023788 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-e44007e6-0b37-46f8-9a01-e1d3a7d5d110 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.035259 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1059d045-00b1-4be3-b443-05eeffb811d9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb36a2e5-86dd-4703-a65f-751437d496a1,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:51.068651 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41772) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:51.089518 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e50963e4-ac55-4ff5-98d2-51de08a9a25e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.127500 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e50963e4-ac55-4ff5-98d2-51de08a9a25e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.136525 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-e44007e6-0b37-46f8-9a01-e1d3a7d5d110 None None] Port abed4d23-da46-4f59-9f36-c9fc12fcb192 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:53:51.209870 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e50963e4-ac55-4ff5-98d2-51de08a9a25e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.212674 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e50963e4-ac55-4ff5-98d2-51de08a9a25e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.216331 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-e50963e4-ac55-4ff5-98d2-51de08a9a25e admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/4cf1e884-71d7-4737-9008-2c5887ebfb7a HTTP/1.1" status: 204 len: 168 time: 0.1975534 Dec 20 05:53:51.222907 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e50963e4-ac55-4ff5-98d2-51de08a9a25e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4cf1e884-71d7-4737-9008-2c5887ebfb7a,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:51.323605 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id abed4d23-da46-4f59-9f36-c9fc12fcb192 {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:53:51.333679 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.378931 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Transition to ACTIVE for port object abed4d23-da46-4f59-9f36-c9fc12fcb192 will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 05:53:51.385928 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.436600 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef0be7d-1b53-4312-91f2-607fa2e44318 req-f5964fa2-fb70-4a89-a42a-275d68ff3e79 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:51.438164 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0ef0be7d-1b53-4312-91f2-607fa2e44318 req-f5964fa2-fb70-4a89-a42a-275d68ff3e79 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 943 time: 0.1095786 Dec 20 05:53:51.518910 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Pushing event updated for resources: {'Port': ['ID=abed4d23-da46-4f59-9f36-c9fc12fcb192,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:51.594282 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42cbeae9-fb48-4864-b148-0a781e162dee req-e7d58fe6-69dd-4fd8-a46c-d7dbdcedc4f2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:51.596620 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42cbeae9-fb48-4864-b148-0a781e162dee req-e7d58fe6-69dd-4fd8-a46c-d7dbdcedc4f2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 943 time: 0.1716261 Dec 20 05:53:51.636408 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-771ae4a6-b115-4129-864d-5ffca93b214f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.647777 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41794) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:51.671742 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0ef0be7d-1b53-4312-91f2-607fa2e44318 req-606355b5-516f-45aa-80fd-b38bbc7b5e35 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2065868 Dec 20 05:53:51.712450 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-b5ca0263-4ed9-4ade-8aa1-518d835519dc admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=99708d316770420cb39fb868b8cfa108&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0608723 Dec 20 05:53:51.713010 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41796) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:51.743684 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42cbeae9-fb48-4864-b148-0a781e162dee req-fa676f00-0c02-4022-ac12-89b96bdc2650 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1332614 Dec 20 05:53:51.748819 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Attempting to bind port abed4d23-da46-4f59-9f36-c9fc12fcb192 on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:53:51.749776 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Attempting to bind port abed4d23-da46-4f59-9f36-c9fc12fcb192 by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:53:51.750205 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Attempting to bind port abed4d23-da46-4f59-9f36-c9fc12fcb192 on network 6924a88e-10c1-4073-a41c-88aad14ebd0f {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:53:51.760654 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Port abed4d23-da46-4f59-9f36-c9fc12fcb192 on network 6924a88e-10c1-4073-a41c-88aad14ebd0f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 05:53:51.761097 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Attempting to bind port abed4d23-da46-4f59-9f36-c9fc12fcb192 on network 6924a88e-10c1-4073-a41c-88aad14ebd0f {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:53:51.772363 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 53, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:53:51.773008 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Checking segment: {'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:53:51.773443 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Bound using segment: {'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:53:51.773751 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Bound port: abed4d23-da46-4f59-9f36-c9fc12fcb192, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:53:51.774129 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.794870 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-863a8aa0-6252-4e0a-932f-a2d1fcc59efb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.830073 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-863a8aa0-6252-4e0a-932f-a2d1fcc59efb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.859305 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-771ae4a6-b115-4129-864d-5ffca93b214f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.870075 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-771ae4a6-b115-4129-864d-5ffca93b214f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.910510 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] For port abed4d23-da46-4f59-9f36-c9fc12fcb192, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:53:51.912196 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-863a8aa0-6252-4e0a-932f-a2d1fcc59efb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.918230 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-863a8aa0-6252-4e0a-932f-a2d1fcc59efb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:51.919364 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-863a8aa0-6252-4e0a-932f-a2d1fcc59efb admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/a73a52c3-f853-4ca0-8d8c-6a553d0eb138 HTTP/1.1" status: 204 len: 168 time: 0.2052779 Dec 20 05:53:51.929539 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-863a8aa0-6252-4e0a-932f-a2d1fcc59efb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a73a52c3-f853-4ca0-8d8c-6a553d0eb138,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:51.959721 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-771ae4a6-b115-4129-864d-5ffca93b214f admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=f8bdf3b508f2400f90301551114fff0f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8900089 Dec 20 05:53:51.961847 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] For port abed4d23-da46-4f59-9f36-c9fc12fcb192, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=abed4d23-da46-4f59-9f36-c9fc12fcb192,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:53:51.962570 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41812) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:51.962877 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-771ae4a6-b115-4129-864d-5ffca93b214f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb17ee56-b5fb-4fb8-9a04-ae354ad3add2,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:51.968258 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.012345 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:52.014029 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.015659 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] 10.222.0.54 "PUT /v2.0/ports/abed4d23-da46-4f59-9f36-c9fc12fcb192 HTTP/1.1" status: 200 len: 1093 time: 1.2152431 Dec 20 05:53:52.016208 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e81aeaf1-e5dc-482f-b37d-b91f972dc6ff', 'tag': 'abed4d23-da46-4f59-9f36-c9fc12fcb192'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:53:52.038148 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41818) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:52.061034 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-322dc565-9585-4120-bbbb-a24117294c54 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.065565 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-72c87ef0-a9f9-4254-a5ab-b099556e0714 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.068134 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38705d92-b9b1-42d9-ba33-27da3957c135 service neutron] Pushing event updated for resources: {'Port': ['ID=abed4d23-da46-4f59-9f36-c9fc12fcb192,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:52.090429 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-322dc565-9585-4120-bbbb-a24117294c54 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.170164 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-322dc565-9585-4120-bbbb-a24117294c54 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.174020 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-322dc565-9585-4120-bbbb-a24117294c54 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.175337 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-322dc565-9585-4120-bbbb-a24117294c54 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/cb17ee56-b5fb-4fb8-9a04-ae354ad3add2 HTTP/1.1" status: 204 len: 168 time: 0.2118423 Dec 20 05:53:52.191764 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-322dc565-9585-4120-bbbb-a24117294c54 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb17ee56-b5fb-4fb8-9a04-ae354ad3add2,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:52.214774 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-494ef0bc-533d-400c-a92c-beacef773575 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:52.216391 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-494ef0bc-533d-400c-a92c-beacef773575 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1898b7c1b3dc4523b09a97486622c67e&device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 1096 time: 0.1303070 Dec 20 05:53:52.298081 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-72c87ef0-a9f9-4254-a5ab-b099556e0714 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.333242 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-72c87ef0-a9f9-4254-a5ab-b099556e0714 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.336330 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-effaa0ff-f810-4323-9ede-371c4a8976cc service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=abed4d23-da46-4f59-9f36-c9fc12fcb192 HTTP/1.1" status: 200 len: 217 time: 0.0899811 Dec 20 05:53:52.424403 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72c87ef0-a9f9-4254-a5ab-b099556e0714 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9851cc79-446b-475f-b5e1-3b388a303a85,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:52.439472 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-72c87ef0-a9f9-4254-a5ab-b099556e0714 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=d4274b441e644bf6b8141baa75fcf836&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3995147 Dec 20 05:53:52.444255 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41832) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:52.463380 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 04f78e54-1e12-4575-b3c2-165c19e74def details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:53:52.466285 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-b71d4c98-f17a-42ab-8c59-46c0997356a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:52.467707 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-b71d4c98-f17a-42ab-8c59-46c0997356a0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ffb588f9-2ffb-4921-8a76-be5179c2fbed HTTP/1.1" status: 200 len: 850 time: 0.1226559 Dec 20 05:53:52.528380 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-bf49ccc7-0636-4235-aba9-7e85cb591be6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.566218 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-bf49ccc7-0636-4235-aba9-7e85cb591be6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.570115 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-938f6e79-eeb0-4b1a-b735-d02276fcb3c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:52.571882 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-938f6e79-eeb0-4b1a-b735-d02276fcb3c5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6924a88e-10c1-4073-a41c-88aad14ebd0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0952706 Dec 20 05:53:52.582892 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 04f78e54-1e12-4575-b3c2-165c19e74def, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=04f78e54-1e12-4575-b3c2-165c19e74def,segment=NetworkSegment(bb43682f-2240-467e-b9ff-f7edf582b7d1),segment_id=bb43682f-2240-467e-b9ff-f7edf582b7d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:53:52.597063 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '04f78e54-1e12-4575-b3c2-165c19e74def', 'network_id': '43c0c2bb-3a2a-478c-b157-c23e2b672361', 'port_id': '04f78e54-1e12-4575-b3c2-165c19e74def', 'mac_address': 'fa:16:3e:56:3b:34', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 426, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '385e0f7c-479c-4f5c-84eb-a5a7aeba6f4c', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:53:52.634575 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-bf49ccc7-0636-4235-aba9-7e85cb591be6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.637485 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-bf49ccc7-0636-4235-aba9-7e85cb591be6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.642002 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-bf49ccc7-0636-4235-aba9-7e85cb591be6 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/9851cc79-446b-475f-b5e1-3b388a303a85 HTTP/1.1" status: 204 len: 168 time: 0.1967137 Dec 20 05:53:52.649958 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf49ccc7-0636-4235-aba9-7e85cb591be6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9851cc79-446b-475f-b5e1-3b388a303a85,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:52.651234 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.669063 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 04f78e54-1e12-4575-b3c2-165c19e74def {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:53:52.704850 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 04f78e54-1e12-4575-b3c2-165c19e74def, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=04f78e54-1e12-4575-b3c2-165c19e74def,segment=NetworkSegment(bb43682f-2240-467e-b9ff-f7edf582b7d1),segment_id=bb43682f-2240-467e-b9ff-f7edf582b7d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:53:52.711154 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:52.775772 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=04f78e54-1e12-4575-b3c2-165c19e74def,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:52.839970 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-131e4936-415f-4c7c-9188-8987c50978eb" -d '{"events": [{"name": "network-changed", "server_uuid": "e81aeaf1-e5dc-482f-b37d-b91f972dc6ff", "tag": "abed4d23-da46-4f59-9f36-c9fc12fcb192"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:53:52.914071 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0a2a9e-2489-4c2f-a474-6e758011b297 req-c07f9db0-2e82-4c54-8de4-34f1e2a97828 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:52.915603 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9e0a2a9e-2489-4c2f-a474-6e758011b297 req-c07f9db0-2e82-4c54-8de4-34f1e2a97828 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 944 time: 0.1055536 Dec 20 05:53:52.917388 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-73753306-1cf3-488f-8caf-58a6804da4b4 service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3354979 Dec 20 05:53:52.970910 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71daff59-3c50-402b-9e71-dd15c14501d0 req-1b51be8c-9412-4c0f-8906-7bba36b8c567 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:52.972373 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-71daff59-3c50-402b-9e71-dd15c14501d0 req-1b51be8c-9412-4c0f-8906-7bba36b8c567 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 943 time: 0.1270671 Dec 20 05:53:53.064999 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9e0a2a9e-2489-4c2f-a474-6e758011b297 req-2d68c7c3-c30e-4d7c-9129-0d9fe6d8eb52 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1398082 Dec 20 05:53:53.065844 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['04f78e54-1e12-4575-b3c2-165c19e74def'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:53:53.101057 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-71daff59-3c50-402b-9e71-dd15c14501d0 req-4ff2e289-6114-43c5-9239-442d8cec6e84 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1187644 Dec 20 05:53:53.106755 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6145f24c-1fd2-4c12-bd75-b2704f07c3db req-0f9b10ff-e8ea-4bd4-ad71-910c0b0ce1af service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1803615 Dec 20 05:53:53.245348 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41868) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:53.268864 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-21895c7c-bf1d-44da-b271-a0a7acb6942e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:53.369582 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-21895c7c-bf1d-44da-b271-a0a7acb6942e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:53.375219 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-21895c7c-bf1d-44da-b271-a0a7acb6942e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:53.406908 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-21895c7c-bf1d-44da-b271-a0a7acb6942e admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=aa553cf04e4e42a8a984de8aa22aa4dc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1602616 Dec 20 05:53:53.409868 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41874) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:53.442072 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21895c7c-bf1d-44da-b271-a0a7acb6942e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af5762fe-0350-4390-ad3b-c8d07d035382,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:53.493796 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-46af21ea-57b7-4c87-9811-4a5e19112526 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:53.520490 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-46af21ea-57b7-4c87-9811-4a5e19112526 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:53.587202 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-46af21ea-57b7-4c87-9811-4a5e19112526 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:53.590608 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-46af21ea-57b7-4c87-9811-4a5e19112526 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:53.591829 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-46af21ea-57b7-4c87-9811-4a5e19112526 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/af5762fe-0350-4390-ad3b-c8d07d035382 HTTP/1.1" status: 204 len: 168 time: 0.1808953 Dec 20 05:53:53.603310 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46af21ea-57b7-4c87-9811-4a5e19112526 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af5762fe-0350-4390-ad3b-c8d07d035382,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:53.673103 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:53:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-369bb2d8-2dba-4d2b-a639-fd30297cab95 x-openstack-request-id: req-369bb2d8-2dba-4d2b-a639-fd30297cab95 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:53:53.673425 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e81aeaf1-e5dc-482f-b37d-b91f972dc6ff", "tag": "abed4d23-da46-4f59-9f36-c9fc12fcb192", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:53:53.673642 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-369bb2d8-2dba-4d2b-a639-fd30297cab95 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:53:53.674404 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e81aeaf1-e5dc-482f-b37d-b91f972dc6ff', 'tag': 'abed4d23-da46-4f59-9f36-c9fc12fcb192', 'status': 'completed', 'code': 200} Dec 20 05:53:53.783175 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-131e4936-415f-4c7c-9188-8987c50978eb req-ca8fafaa-94ee-43dd-b92e-d35d33389010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:53.784770 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-131e4936-415f-4c7c-9188-8987c50978eb req-ca8fafaa-94ee-43dd-b92e-d35d33389010 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1898b7c1b3dc4523b09a97486622c67e&device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 1096 time: 0.0423756 Dec 20 05:53:53.969971 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-131e4936-415f-4c7c-9188-8987c50978eb req-30b14a58-03a3-4d12-a076-e89ae942e937 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:53.972572 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-131e4936-415f-4c7c-9188-8987c50978eb req-30b14a58-03a3-4d12-a076-e89ae942e937 service neutron] 10.222.0.54 "GET /v2.0/networks?id=6924a88e-10c1-4073-a41c-88aad14ebd0f HTTP/1.1" status: 200 len: 912 time: 0.1710696 Dec 20 05:53:54.026824 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-131e4936-415f-4c7c-9188-8987c50978eb req-13cd1130-10ca-4639-a2d9-273be110551d service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=abed4d23-da46-4f59-9f36-c9fc12fcb192 HTTP/1.1" status: 200 len: 217 time: 0.0466919 Dec 20 05:53:54.092341 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-131e4936-415f-4c7c-9188-8987c50978eb req-15eb7108-e808-4630-8dee-2757200d6e75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:54.095824 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-131e4936-415f-4c7c-9188-8987c50978eb req-15eb7108-e808-4630-8dee-2757200d6e75 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ffb588f9-2ffb-4921-8a76-be5179c2fbed HTTP/1.1" status: 200 len: 850 time: 0.0600147 Dec 20 05:53:54.154679 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41912) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:54.186323 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-131e4936-415f-4c7c-9188-8987c50978eb req-108ae98b-5fbc-41d4-bb21-74b2143e4fd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:54.187908 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-131e4936-415f-4c7c-9188-8987c50978eb req-108ae98b-5fbc-41d4-bb21-74b2143e4fd4 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6924a88e-10c1-4073-a41c-88aad14ebd0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0847366 Dec 20 05:53:54.247829 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3ac0db-dc05-49dc-935c-1fa21d750efd req-cb9ac4bf-67d6-4094-995a-7536afcbba8f tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:54.249282 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2e3ac0db-dc05-49dc-935c-1fa21d750efd req-cb9ac4bf-67d6-4094-995a-7536afcbba8f tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 944 time: 0.1089280 Dec 20 05:53:54.340021 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ad4c91-3473-4d29-8c71-b297c1b49de5 req-587a8e4f-bf13-4757-9472-4dca59e55925 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:54.341517 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-62ad4c91-3473-4d29-8c71-b297c1b49de5 req-587a8e4f-bf13-4757-9472-4dca59e55925 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 943 time: 0.1455393 Dec 20 05:53:54.376060 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-131e4936-415f-4c7c-9188-8987c50978eb req-095fc545-4962-4350-80ec-59ccb8a6dc1f service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1775346 Dec 20 05:53:54.414169 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2e3ac0db-dc05-49dc-935c-1fa21d750efd req-37c06f7c-bac4-4cd0-a9a1-9b8e72858af5 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1541705 Dec 20 05:53:54.447224 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device abed4d23-da46-4f59-9f36-c9fc12fcb192 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:53:54.484829 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-62ad4c91-3473-4d29-8c71-b297c1b49de5 req-63cc3a76-119c-48b8-9ac4-7e8c4ec20d0c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1218228 Dec 20 05:53:54.499901 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 04f78e54-1e12-4575-b3c2-165c19e74def up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:53:54.560122 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-131e4936-415f-4c7c-9188-8987c50978eb req-729e0047-7563-40e3-9b2c-e70a4f865e31 service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1637194 Dec 20 05:53:54.560718 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8b851a59-2bd9-443f-8b85-19b22a1878ec admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:54.627222 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port abed4d23-da46-4f59-9f36-c9fc12fcb192, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=abed4d23-da46-4f59-9f36-c9fc12fcb192,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:53:54.630344 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port 04f78e54-1e12-4575-b3c2-165c19e74def completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 05:53:54.642509 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 04f78e54-1e12-4575-b3c2-165c19e74def triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:53:54.642870 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:54.669841 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8b851a59-2bd9-443f-8b85-19b22a1878ec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:54.675540 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': 'abed4d23-da46-4f59-9f36-c9fc12fcb192', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'port_id': 'abed4d23-da46-4f59-9f36-c9fc12fcb192', 'mac_address': 'fa:16:3e:f1:9b:a0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 449, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:53:54.675904 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8b851a59-2bd9-443f-8b85-19b22a1878ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:54.726939 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-8b851a59-2bd9-443f-8b85-19b22a1878ec admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=4667b502b16845a0aeb4d3eb6aae510c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5692546 Dec 20 05:53:54.726939 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b851a59-2bd9-443f-8b85-19b22a1878ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b74be945-cf2b-41d8-b07f-3558cfec3018,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:54.727585 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 41936) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:54.770021 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:54.792250 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d9739641-f326-4a3c-9bb4-b504d6824825 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:54.795457 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id abed4d23-da46-4f59-9f36-c9fc12fcb192 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:53:54.818784 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:54.822601 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d9739641-f326-4a3c-9bb4-b504d6824825 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:54.839049 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port abed4d23-da46-4f59-9f36-c9fc12fcb192, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=abed4d23-da46-4f59-9f36-c9fc12fcb192,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:53:54.847238 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:54.855342 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3c23e2c6-db4c-4766-8571-6e612c92168e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '04f78e54-1e12-4575-b3c2-165c19e74def'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:53:54.880295 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d9739641-f326-4a3c-9bb4-b504d6824825 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:54.882833 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d9739641-f326-4a3c-9bb4-b504d6824825 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:54.886812 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-d9739641-f326-4a3c-9bb4-b504d6824825 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/b74be945-cf2b-41d8-b07f-3558cfec3018 HTTP/1.1" status: 204 len: 168 time: 0.1558919 Dec 20 05:53:54.894526 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9739641-f326-4a3c-9bb4-b504d6824825 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b74be945-cf2b-41d8-b07f-3558cfec3018,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:54.960840 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 04f78e54-1e12-4575-b3c2-165c19e74def, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=04f78e54-1e12-4575-b3c2-165c19e74def,segment=NetworkSegment(bb43682f-2240-467e-b9ff-f7edf582b7d1),segment_id=bb43682f-2240-467e-b9ff-f7edf582b7d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:53:54.972494 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:54.979664 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:53:54.991457 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=abed4d23-da46-4f59-9f36-c9fc12fcb192,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:55.042141 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=04f78e54-1e12-4575-b3c2-165c19e74def,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:55.188532 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['abed4d23-da46-4f59-9f36-c9fc12fcb192'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:53:55.520175 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9c0e4e37-3e76-4c94-b47c-404fdf3526ff" -d '{"events": [{"server_uuid": "3c23e2c6-db4c-4766-8571-6e612c92168e", "name": "network-vif-plugged", "status": "completed", "tag": "04f78e54-1e12-4575-b3c2-165c19e74def"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:53:55.554851 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265b3bb9-fa77-4cde-a87b-8b0fc08fddbd req-3490c4eb-a552-4aeb-9c57-21fadc7e2f41 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:55.556595 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-265b3bb9-fa77-4cde-a87b-8b0fc08fddbd req-3490c4eb-a552-4aeb-9c57-21fadc7e2f41 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0668809 Dec 20 05:53:55.637872 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99e841f1-c014-4f2f-8375-a69247c86869 req-4a2b8ac7-5c83-432a-b570-28e898069534 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:55.639635 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-99e841f1-c014-4f2f-8375-a69247c86869 req-4a2b8ac7-5c83-432a-b570-28e898069534 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 944 time: 0.0817173 Dec 20 05:53:55.659898 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-265b3bb9-fa77-4cde-a87b-8b0fc08fddbd req-a5e269d3-aa80-4892-a141-9794e28d59dc tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0933163 Dec 20 05:53:55.678812 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 41986) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:55.716442 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-99e841f1-c014-4f2f-8375-a69247c86869 req-20404876-297a-4eb0-abf3-410204fd86c1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0673130 Dec 20 05:53:55.920667 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1902967197-network', 'tenant_id': '8c63fd9e08834fa5b16c3ee09e6a5bb6'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:55.948060 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] Made reservation on behalf of 8c63fd9e08834fa5b16c3ee09e6a5bb6 for: {'network': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:53:55.949943 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:55.962129 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:55.974280 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:53:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7f13958-51c6-47a6-a6e5-c49fc4eb8f7c x-openstack-request-id: req-b7f13958-51c6-47a6-a6e5-c49fc4eb8f7c {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:53:55.974597 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3c23e2c6-db4c-4766-8571-6e612c92168e", "name": "network-vif-plugged", "status": "completed", "tag": "04f78e54-1e12-4575-b3c2-165c19e74def", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:53:55.975208 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-b7f13958-51c6-47a6-a6e5-c49fc4eb8f7c {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:53:55.975860 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3c23e2c6-db4c-4766-8571-6e612c92168e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '04f78e54-1e12-4575-b3c2-165c19e74def', 'code': 200} Dec 20 05:53:56.053259 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.060776 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.083986 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] vlan segment allocate from pool success with {'vlan_id': 435, 'physical_network': 'physnet1'} {{(pid=102445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:53:56.099876 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e49658f-5032-4765-b991-cff1d0290cf1,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:56.102721 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.103058 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.segments_db [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] Added segment 9888abfe-4264-4a19-a32b-176574ac7c6c of type vlan for network d7623a03-8fb7-4995-aaba-531582991739 Dec 20 05:53:56.146308 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.179866 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.180941 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:56.181611 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.218639 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5382555 Dec 20 05:53:56.222204 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42014) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:56.229475 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-685e2b40-b3d8-48bb-a6a7-4733ea2dc2d3 admin admin] Request body: {'subnet': {'network_id': 'd7623a03-8fb7-4995-aaba-531582991739', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1902967197-subnet', 'tenant_id': '8c63fd9e08834fa5b16c3ee09e6a5bb6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:56.266535 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-685e2b40-b3d8-48bb-a6a7-4733ea2dc2d3 admin admin] Made reservation on behalf of 8c63fd9e08834fa5b16c3ee09e6a5bb6 for: {'subnet': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:53:56.270115 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-685e2b40-b3d8-48bb-a6a7-4733ea2dc2d3 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3270951'] for subnet, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.301641 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af5497a1-29ff-4d15-b1be-43aae8104ff7 admin admin] Pushing event updated for resources: {'Network': ['ID=d7623a03-8fb7-4995-aaba-531582991739,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:56.315002 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network d7623a03-8fb7-4995-aaba-531582991739 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:53:56.330430 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00fe6c1b-b3b1-4ca9-95a1-1799e12a4393 req-796c1345-308d-4f0d-91c2-f63bd78c296c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:56.332109 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-00fe6c1b-b3b1-4ca9-95a1-1799e12a4393 req-796c1345-308d-4f0d-91c2-f63bd78c296c service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 1098 time: 0.0823166 Dec 20 05:53:56.373287 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-00fe6c1b-b3b1-4ca9-95a1-1799e12a4393 req-58d7ad01-345a-4f2f-a503-bcc6f6fb50ee service neutron] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.464230 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device abed4d23-da46-4f59-9f36-c9fc12fcb192 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:53:56.540243 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-00fe6c1b-b3b1-4ca9-95a1-1799e12a4393 req-58d7ad01-345a-4f2f-a503-bcc6f6fb50ee service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.548189 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-00fe6c1b-b3b1-4ca9-95a1-1799e12a4393 req-58d7ad01-345a-4f2f-a503-bcc6f6fb50ee service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.576306 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-685e2b40-b3d8-48bb-a6a7-4733ea2dc2d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9168037', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3270985'] for subnet, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.582374 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port abed4d23-da46-4f59-9f36-c9fc12fcb192 completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 05:53:56.592763 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port abed4d23-da46-4f59-9f36-c9fc12fcb192 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:53:56.598434 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.612528 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d7ad01-345a-4f2f-a503-bcc6f6fb50ee service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=ba89da3b-625f-4417-a96e-b88b90860b0d,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:56.619339 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-00fe6c1b-b3b1-4ca9-95a1-1799e12a4393 req-58d7ad01-345a-4f2f-a503-bcc6f6fb50ee service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2782481 Dec 20 05:53:56.698188 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-685e2b40-b3d8-48bb-a6a7-4733ea2dc2d3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=06ed926b-b87a-4029-96f3-a2c1ccb7d6a8,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:56.704829 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-685e2b40-b3d8-48bb-a6a7-4733ea2dc2d3 admin admin] Checking segment: {'id': '9888abfe-4264-4a19-a32b-176574ac7c6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': 'd7623a03-8fb7-4995-aaba-531582991739'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:53:56.705196 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-685e2b40-b3d8-48bb-a6a7-4733ea2dc2d3 admin admin] Network hostable DHCP agents. Network: d7623a03-8fb7-4995-aaba-531582991739, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102446) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:53:56.728915 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-685e2b40-b3d8-48bb-a6a7-4733ea2dc2d3 admin admin] Network d7623a03-8fb7-4995-aaba-531582991739 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102446) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:53:56.754938 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-685e2b40-b3d8-48bb-a6a7-4733ea2dc2d3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, d7623a03-8fb7-4995-aaba-531582991739) {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:53:56.756650 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.774479 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-685e2b40-b3d8-48bb-a6a7-4733ea2dc2d3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:56.775296 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-685e2b40-b3d8-48bb-a6a7-4733ea2dc2d3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.791818 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-088bed99-802f-4772-bfcb-60d698b7d6ca None None] Network d7623a03-8fb7-4995-aaba-531582991739 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:53:56.817860 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-685e2b40-b3d8-48bb-a6a7-4733ea2dc2d3 admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.5945246 Dec 20 05:53:56.872284 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7235582-8015-4bf0-a6aa-8b94826f4dc1 req-a087d89a-08cf-47bc-9430-fc761c4ffb26 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:56.874803 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b7235582-8015-4bf0-a6aa-8b94826f4dc1 req-a087d89a-08cf-47bc-9430-fc761c4ffb26 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0680804 Dec 20 05:53:56.917435 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port abed4d23-da46-4f59-9f36-c9fc12fcb192, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=abed4d23-da46-4f59-9f36-c9fc12fcb192,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:53:56.927427 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:56.968750 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddfae42d-a464-4c37-95c3-02f1c8be6c2b req-64d2c675-c7ed-49b6-a950-793e1f20f378 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:56.970283 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ddfae42d-a464-4c37-95c3-02f1c8be6c2b req-64d2c675-c7ed-49b6-a950-793e1f20f378 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 944 time: 0.0924516 Dec 20 05:53:56.973517 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b7235582-8015-4bf0-a6aa-8b94826f4dc1 req-0283f8d0-b312-4d1f-a8e1-0c8b0a7f68cc tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0854492 Dec 20 05:53:56.991010 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2045f099-49fa-4275-9fb6-990442ecd0f0 None None] Network d7623a03-8fb7-4995-aaba-531582991739 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:53:57.042805 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ddfae42d-a464-4c37-95c3-02f1c8be6c2b req-71254bce-e075-44ca-8547-d5787b87631b tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0661175 Dec 20 05:53:57.045124 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=abed4d23-da46-4f59-9f36-c9fc12fcb192,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:57.889035 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42112) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:57.977632 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e81aeaf1-e5dc-482f-b37d-b91f972dc6ff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'abed4d23-da46-4f59-9f36-c9fc12fcb192'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:53:57.981356 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3eb21ce7-3b88-4a8e-893d-4cf5b4137efd" -d '{"events": [{"server_uuid": "e81aeaf1-e5dc-482f-b37d-b91f972dc6ff", "name": "network-vif-plugged", "status": "completed", "tag": "abed4d23-da46-4f59-9f36-c9fc12fcb192"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:53:58.038191 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:53:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-71794c5d-46ea-4d6b-b2cc-e47db87f4e2e x-openstack-request-id: req-71794c5d-46ea-4d6b-b2cc-e47db87f4e2e {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:53:58.038509 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e81aeaf1-e5dc-482f-b37d-b91f972dc6ff", "name": "network-vif-plugged", "status": "completed", "tag": "abed4d23-da46-4f59-9f36-c9fc12fcb192", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:53:58.038763 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-71794c5d-46ea-4d6b-b2cc-e47db87f4e2e {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:53:58.039148 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e81aeaf1-e5dc-482f-b37d-b91f972dc6ff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'abed4d23-da46-4f59-9f36-c9fc12fcb192', 'code': 200} Dec 20 05:53:58.108159 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cb30a161-ee9b-40d0-9f93-3e78df9b6b78 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.208429 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cb30a161-ee9b-40d0-9f93-3e78df9b6b78 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.213990 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cb30a161-ee9b-40d0-9f93-3e78df9b6b78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.235413 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42136) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:58.250859 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-734405332-network', 'tenant_id': '4f9a8a9f582a4b6a85e260fe47c03fe7'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:58.277439 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb30a161-ee9b-40d0-9f93-3e78df9b6b78 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e1c88178-51ef-433d-93b1-918f11bb2b84,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:58.286819 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-cb30a161-ee9b-40d0-9f93-3e78df9b6b78 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=29b46be14b24426d84b1a33a55b25df7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3936815 Dec 20 05:53:58.288774 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42138) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:58.306833 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db15e74-0921-49f8-83c8-f842e94d50f4 req-70c8db3e-96f2-44f2-989a-8e647cb20869 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:58.315281 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6db15e74-0921-49f8-83c8-f842e94d50f4 req-70c8db3e-96f2-44f2-989a-8e647cb20869 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.2523618 Dec 20 05:53:58.318163 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] Made reservation on behalf of 4f9a8a9f582a4b6a85e260fe47c03fe7 for: {'network': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:53:58.320664 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.335344 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.345607 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72028ac6-6245-40e2-8423-7247b0c48f4c req-a7368223-87a1-43a8-b583-ba6b820bd72a tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:58.347351 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-72028ac6-6245-40e2-8423-7247b0c48f4c req-a7368223-87a1-43a8-b583-ba6b820bd72a tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.1051419 Dec 20 05:53:58.395560 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2eb57ea2-c30c-40ba-8255-713f30b0f369 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.407362 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6db15e74-0921-49f8-83c8-f842e94d50f4 req-a8995a93-22b9-485a-abc6-6cf2a0ce011e tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0908182 Dec 20 05:53:58.429063 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2eb57ea2-c30c-40ba-8255-713f30b0f369 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.449464 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-72028ac6-6245-40e2-8423-7247b0c48f4c req-b03ea466-ce85-4f35-aced-207e3b25769a tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0936584 Dec 20 05:53:58.480945 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.486448 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.514375 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2eb57ea2-c30c-40ba-8255-713f30b0f369 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.517078 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2eb57ea2-c30c-40ba-8255-713f30b0f369 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.518196 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-2eb57ea2-c30c-40ba-8255-713f30b0f369 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/e1c88178-51ef-433d-93b1-918f11bb2b84 HTTP/1.1" status: 204 len: 168 time: 0.2294860 Dec 20 05:53:58.522515 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] vlan segment allocate from pool success with {'vlan_id': 421, 'physical_network': 'physnet1'} {{(pid=102446) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:53:58.524860 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a7f423d-f917-4cfe-b599-4f40def310da,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:58.540903 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.544442 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.segments_db [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] Added segment 57275fcb-7877-4aad-a636-7006fa81785e of type vlan for network 4f8d634b-43c9-489e-b019-103f56ae0bef Dec 20 05:53:58.544442 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eb57ea2-c30c-40ba-8255-713f30b0f369 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e1c88178-51ef-433d-93b1-918f11bb2b84,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:58.776937 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.802492 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.803633 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:58.804227 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:58.839384 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 42158) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:58.839560 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.6021664 Dec 20 05:53:58.845107 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-7bccd70a-1b96-41ea-80d2-aa9669406aae admin admin] Request body: {'subnet': {'network_id': '4f8d634b-43c9-489e-b019-103f56ae0bef', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-734405332-subnet', 'tenant_id': '4f9a8a9f582a4b6a85e260fe47c03fe7', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:53:58.877278 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f539fe0-b4ff-48ba-a7e9-9d6ceb7a32aa admin admin] Pushing event updated for resources: {'Network': ['ID=4f8d634b-43c9-489e-b019-103f56ae0bef,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:58.894614 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network 4f8d634b-43c9-489e-b019-103f56ae0bef details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:53:58.898251 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7bccd70a-1b96-41ea-80d2-aa9669406aae admin admin] Made reservation on behalf of 4f9a8a9f582a4b6a85e260fe47c03fe7 for: {'subnet': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:53:58.901378 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-7bccd70a-1b96-41ea-80d2-aa9669406aae admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3597747'] for subnet, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:59.094055 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42168) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:59.113044 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-433828c6-2a3b-4a69-b2a5-2bfcb2b94966 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:59.118909 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-7bccd70a-1b96-41ea-80d2-aa9669406aae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3457622', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3597789'] for subnet, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:59.199680 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bccd70a-1b96-41ea-80d2-aa9669406aae admin admin] Checking segment: {'id': '57275fcb-7877-4aad-a636-7006fa81785e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 421, 'network_id': '4f8d634b-43c9-489e-b019-103f56ae0bef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:53:59.200141 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bccd70a-1b96-41ea-80d2-aa9669406aae admin admin] Network hostable DHCP agents. Network: 4f8d634b-43c9-489e-b019-103f56ae0bef, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:53:59.205143 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bccd70a-1b96-41ea-80d2-aa9669406aae admin admin] Pushing event updated for resources: {'Subnet': ['ID=7a43f95c-34f3-4424-b721-2bdfcd28309f,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:59.210852 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-433828c6-2a3b-4a69-b2a5-2bfcb2b94966 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:59.216292 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-433828c6-2a3b-4a69-b2a5-2bfcb2b94966 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:59.234196 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bccd70a-1b96-41ea-80d2-aa9669406aae admin admin] Network 4f8d634b-43c9-489e-b019-103f56ae0bef is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:53:59.255705 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-7bccd70a-1b96-41ea-80d2-aa9669406aae admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, 4f8d634b-43c9-489e-b019-103f56ae0bef) {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:53:59.267104 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cafa2b7-65d1-4dc7-8727-ad02fc147417 None None] Network 4f8d634b-43c9-489e-b019-103f56ae0bef requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:53:59.271190 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-433828c6-2a3b-4a69-b2a5-2bfcb2b94966 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=f19d890770094491b5f9320b06298fe9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1729670 Dec 20 05:53:59.271190 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-433828c6-2a3b-4a69-b2a5-2bfcb2b94966 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e00cc92c-46db-4980-ba85-72038276258e,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:59.272456 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42176) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:53:59.287338 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7bccd70a-1b96-41ea-80d2-aa9669406aae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:59.287979 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-7bccd70a-1b96-41ea-80d2-aa9669406aae admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:59.336231 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-7bccd70a-1b96-41ea-80d2-aa9669406aae admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.4952009 Dec 20 05:53:59.355402 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3b1d4059-161d-4ead-962e-3ff75a2c3af8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:59.381107 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3b1d4059-161d-4ead-962e-3ff75a2c3af8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:59.441370 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85714c16-01fc-4413-8d16-c365f26f249a None None] Network 4f8d634b-43c9-489e-b019-103f56ae0bef requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:53:59.443843 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3b1d4059-161d-4ead-962e-3ff75a2c3af8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:59.449879 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3b1d4059-161d-4ead-962e-3ff75a2c3af8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:53:59.456227 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-3b1d4059-161d-4ead-962e-3ff75a2c3af8 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/e00cc92c-46db-4980-ba85-72038276258e HTTP/1.1" status: 204 len: 168 time: 0.1802309 Dec 20 05:53:59.461878 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b1d4059-161d-4ead-962e-3ff75a2c3af8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e00cc92c-46db-4980-ba85-72038276258e,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:53:59.598082 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ac2d51-032a-4573-a4fa-26d0d2ce58ea req-0fb33bde-b54e-4706-8637-26b963fbb11f tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:59.599703 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d6ac2d51-032a-4573-a4fa-26d0d2ce58ea req-0fb33bde-b54e-4706-8637-26b963fbb11f tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0948889 Dec 20 05:53:59.643252 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3401a5fa-6faf-478a-a972-befdf0ef3c42 req-e4b51873-da0d-4c02-9739-977b14b456dd tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:53:59.644755 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3401a5fa-6faf-478a-a972-befdf0ef3c42 req-e4b51873-da0d-4c02-9739-977b14b456dd tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0816205 Dec 20 05:53:59.680454 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d6ac2d51-032a-4573-a4fa-26d0d2ce58ea req-b2f91350-89aa-49ff-87f5-e9bf56762588 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696282 Dec 20 05:53:59.720197 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3401a5fa-6faf-478a-a972-befdf0ef3c42 req-b062b1f8-2048-4a73-8594-f7b3c014e0c4 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0640860 Dec 20 05:54:00.222342 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c37f202-91dc-411f-ae2b-9734e0dcae1c req-ac4a68d8-1352-4d8a-ab6c-b06e39ed2dd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:00.227057 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3c37f202-91dc-411f-ae2b-9734e0dcae1c req-ac4a68d8-1352-4d8a-ab6c-b06e39ed2dd0 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 1098 time: 0.0657051 Dec 20 05:54:00.302121 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3c37f202-91dc-411f-ae2b-9734e0dcae1c req-7ed6062f-97f5-497b-942c-2a4cc530daac service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0687444 Dec 20 05:54:00.794730 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42262) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:00.815834 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ee400f-bfa3-4084-b07a-3f9aca061321 req-735f2bf8-e32a-4dd0-bcd6-43695a035707 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:00.817309 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-89ee400f-bfa3-4084-b07a-3f9aca061321 req-735f2bf8-e32a-4dd0-bcd6-43695a035707 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0599036 Dec 20 05:54:00.872083 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19a772c8-a884-44a4-bfcd-a0e420503454 req-9729aa00-ee2b-4cdb-b6e5-e9b1367dccab tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:00.873567 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-19a772c8-a884-44a4-bfcd-a0e420503454 req-9729aa00-ee2b-4cdb-b6e5-e9b1367dccab tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0799739 Dec 20 05:54:00.913223 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f24bfc64-54b5-4150-86fc-01e9d12e4120 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:00.914980 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-89ee400f-bfa3-4084-b07a-3f9aca061321 req-d4b98f53-7d0b-4103-a0e8-72a123b18c01 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836225 Dec 20 05:54:00.940592 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-19a772c8-a884-44a4-bfcd-a0e420503454 req-e48ffb52-c7e2-4f3f-b596-6ecf0b21339d tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0604889 Dec 20 05:54:00.992337 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f24bfc64-54b5-4150-86fc-01e9d12e4120 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:00.996175 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f24bfc64-54b5-4150-86fc-01e9d12e4120 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:01.033656 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-f24bfc64-54b5-4150-86fc-01e9d12e4120 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=54360af8610a40a281a5a390f2bc3a76&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2376642 Dec 20 05:54:01.034509 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f24bfc64-54b5-4150-86fc-01e9d12e4120 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9fe5c0f1-31ff-41fa-bef1-ad95139182d5,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:01.036436 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 42272) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:01.086862 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-2410497a-d46f-4310-a699-da212bade628 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:01.111482 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-2410497a-d46f-4310-a699-da212bade628 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:01.167709 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-2410497a-d46f-4310-a699-da212bade628 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:01.171730 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-2410497a-d46f-4310-a699-da212bade628 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:01.172880 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-2410497a-d46f-4310-a699-da212bade628 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/9fe5c0f1-31ff-41fa-bef1-ad95139182d5 HTTP/1.1" status: 204 len: 168 time: 0.1353860 Dec 20 05:54:01.181046 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2410497a-d46f-4310-a699-da212bade628 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9fe5c0f1-31ff-41fa-bef1-ad95139182d5,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:01.723574 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-67f0bfe4-6da9-42f6-a706-51b0b64ad76a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:02.138575 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec49e97c-426f-4e91-b28e-309aa8d57efa req-6dde75c3-c3c4-4b9b-b552-f502508336cf tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:02.141336 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ec49e97c-426f-4e91-b28e-309aa8d57efa req-6dde75c3-c3c4-4b9b-b552-f502508336cf tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.1059194 Dec 20 05:54:02.168376 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb4fc00-7f49-4739-b3de-f8abb99b6a65 req-944e2232-8a25-48f7-906c-8dca2aa9897a tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:02.176248 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2eb4fc00-7f49-4739-b3de-f8abb99b6a65 req-944e2232-8a25-48f7-906c-8dca2aa9897a tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.1124871 Dec 20 05:54:02.260794 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ec49e97c-426f-4e91-b28e-309aa8d57efa req-aa537f35-8fd2-4d85-875b-1bdb0267fb6b tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1039181 Dec 20 05:54:02.266723 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2eb4fc00-7f49-4739-b3de-f8abb99b6a65 req-d9d2b36b-e590-4b42-817c-3a7ad305e976 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0886924 Dec 20 05:54:02.489906 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de468808-05ad-4872-9213-c5780bb5143e req-1cafee97-fcc1-4a22-8e8e-9b76979c31e9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:02.492041 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-de468808-05ad-4872-9213-c5780bb5143e req-1cafee97-fcc1-4a22-8e8e-9b76979c31e9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0733118 Dec 20 05:54:02.501505 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 42376) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:02.506339 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-1bfa322b-f172-49d3-a2f8-56a81fc24b62 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Request body: {'floatingip': {'port_id': 'abed4d23-da46-4f59-9f36-c9fc12fcb192'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:54:02.596864 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-1bfa322b-f172-49d3-a2f8-56a81fc24b62 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for floatingip, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:02.720192 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42380) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:02.953703 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-23d3ea9d-8ce8-46e8-8b48-d2317dce273a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:03.033136 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-23d3ea9d-8ce8-46e8-8b48-d2317dce273a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:03.037030 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-23d3ea9d-8ce8-46e8-8b48-d2317dce273a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:03.080986 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-23d3ea9d-8ce8-46e8-8b48-d2317dce273a admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=737e8be65a044400b3ad6e33a969d977&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3585114 Dec 20 05:54:03.082589 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 42400) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:03.086196 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23d3ea9d-8ce8-46e8-8b48-d2317dce273a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fb2823d-647d-4fe9-bc15-f486ac42728b,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:03.398315 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8dd6ae79-f550-4c5a-9920-356ec540e4aa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:03.474499 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8dd6ae79-f550-4c5a-9920-356ec540e4aa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:03.667183 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-1bfa322b-f172-49d3-a2f8-56a81fc24b62 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:03.668638 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8dd6ae79-f550-4c5a-9920-356ec540e4aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:03.672569 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8dd6ae79-f550-4c5a-9920-356ec540e4aa admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:03.673743 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-8dd6ae79-f550-4c5a-9920-356ec540e4aa admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/2fb2823d-647d-4fe9-bc15-f486ac42728b HTTP/1.1" status: 204 len: 168 time: 0.5902357 Dec 20 05:54:03.679161 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-1bfa322b-f172-49d3-a2f8-56a81fc24b62 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:03.730153 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dd6ae79-f550-4c5a-9920-356ec540e4aa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fb2823d-647d-4fe9-bc15-f486ac42728b,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:03.810994 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.l3_db [None req-1bfa322b-f172-49d3-a2f8-56a81fc24b62 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Floating IP d1719efe-7c3d-4c2b-8a5a-91c7554f551c associated. External IP: 172.27.3.226, port: abed4d23-da46-4f59-9f36-c9fc12fcb192. Dec 20 05:54:04.025632 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42438) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:04.033399 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1bfa322b-f172-49d3-a2f8-56a81fc24b62 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Router 3f858ad2-b10f-4f04-9727-f99638a01796 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:54:04.039809 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8362daa9-e654-4d5e-9cd8-eeddb641b4c1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:04.117580 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8362daa9-e654-4d5e-9cd8-eeddb641b4c1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:04.121319 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8362daa9-e654-4d5e-9cd8-eeddb641b4c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:04.146910 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1bfa322b-f172-49d3-a2f8-56a81fc24b62 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:54:04.151767 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-1bfa322b-f172-49d3-a2f8-56a81fc24b62 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:04.158650 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-be1da6bf-6029-4a27-b144-c01ee209a17a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:04.161966 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-8362daa9-e654-4d5e-9cd8-eeddb641b4c1 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=c4acabdf91b84393a4260829e78da52e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1352408 Dec 20 05:54:04.163983 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2de3c95e-7f2e-4b4a-8068-8b5bfbac5482 None None] Sync routers for ids ['3f858ad2-b10f-4f04-9727-f99638a01796'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:54:04.167148 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42440) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:04.169144 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8362daa9-e654-4d5e-9cd8-eeddb641b4c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4133fbaf-69c9-4329-bc42-bb71ed8e4b9a,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:04.179177 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2de3c95e-7f2e-4b4a-8068-8b5bfbac5482 None None] Routers {'3f858ad2-b10f-4f04-9727-f99638a01796'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:54:04.180540 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-2de3c95e-7f2e-4b4a-8068-8b5bfbac5482 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:54:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['3f858ad2-b10f-4f04-9727-f99638a01796'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:04.187139 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-1bfa322b-f172-49d3-a2f8-56a81fc24b62 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "PUT /v2.0/floatingips/d1719efe-7c3d-4c2b-8a5a-91c7554f551c HTTP/1.1" status: 200 len: 991 time: 1.6813433 Dec 20 05:54:04.187139 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e81aeaf1-e5dc-482f-b37d-b91f972dc6ff', 'tag': 'abed4d23-da46-4f59-9f36-c9fc12fcb192'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:54:04.189126 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d3afd683-31e9-4e41-a6ea-adca718118e0" -d '{"events": [{"name": "network-changed", "server_uuid": "e81aeaf1-e5dc-482f-b37d-b91f972dc6ff", "tag": "abed4d23-da46-4f59-9f36-c9fc12fcb192"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:54:04.225127 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-abbc6998-e31d-4d0d-96a3-06012e1e8a62 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:04.236588 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:54:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-839b943a-cbbc-444f-a918-b6e7fd8ed810 x-openstack-request-id: req-839b943a-cbbc-444f-a918-b6e7fd8ed810 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:54:04.237178 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e81aeaf1-e5dc-482f-b37d-b91f972dc6ff", "tag": "abed4d23-da46-4f59-9f36-c9fc12fcb192", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:54:04.238009 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-839b943a-cbbc-444f-a918-b6e7fd8ed810 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:54:04.238516 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e81aeaf1-e5dc-482f-b37d-b91f972dc6ff', 'tag': 'abed4d23-da46-4f59-9f36-c9fc12fcb192', 'status': 'completed', 'code': 200} Dec 20 05:54:04.251981 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-abbc6998-e31d-4d0d-96a3-06012e1e8a62 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:04.301479 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-abbc6998-e31d-4d0d-96a3-06012e1e8a62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:04.302382 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-2de3c95e-7f2e-4b4a-8068-8b5bfbac5482 None None] Set router 3f858ad2-b10f-4f04-9727-f99638a01796 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:54:04.304131 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-abbc6998-e31d-4d0d-96a3-06012e1e8a62 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:04.305273 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-abbc6998-e31d-4d0d-96a3-06012e1e8a62 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/4133fbaf-69c9-4329-bc42-bb71ed8e4b9a HTTP/1.1" status: 204 len: 168 time: 0.1370661 Dec 20 05:54:04.314116 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abbc6998-e31d-4d0d-96a3-06012e1e8a62 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4133fbaf-69c9-4329-bc42-bb71ed8e4b9a,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:04.577837 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-2de3c95e-7f2e-4b4a-8068-8b5bfbac5482 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': 'd1719efe-7c3d-4c2b-8a5a-91c7554f551c', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'floating_ip_address': '172.27.3.226', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'port_id': 'abed4d23-da46-4f59-9f36-c9fc12fcb192', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 93, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'mac_address': 'fa:16:3e:f1:9b:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e81aeaf1-e5dc-482f-b37d-b91f972dc6ff', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:53:35Z', 'updated_at': '2021-12-20T05:54:03Z', 'revision_number': 1, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:35Z', 'revision_number': 5, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:04.692825 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2de3c95e-7f2e-4b4a-8068-8b5bfbac5482 None None] Checking router: 3f858ad2-b10f-4f04-9727-f99638a01796 for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:54:04.694783 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2de3c95e-7f2e-4b4a-8068-8b5bfbac5482 None None] Routers {'3f858ad2-b10f-4f04-9727-f99638a01796'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:54:04.695387 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-2de3c95e-7f2e-4b4a-8068-8b5bfbac5482 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:54:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['3f858ad2-b10f-4f04-9727-f99638a01796'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:04.798317 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-2de3c95e-7f2e-4b4a-8068-8b5bfbac5482 None None] Set router 3f858ad2-b10f-4f04-9727-f99638a01796 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:54:04.972960 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:05.036705 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-2de3c95e-7f2e-4b4a-8068-8b5bfbac5482 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': 'd1719efe-7c3d-4c2b-8a5a-91c7554f551c', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'floating_ip_address': '172.27.3.226', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'port_id': 'abed4d23-da46-4f59-9f36-c9fc12fcb192', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 93, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'mac_address': 'fa:16:3e:f1:9b:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e81aeaf1-e5dc-482f-b37d-b91f972dc6ff', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:53:35Z', 'updated_at': '2021-12-20T05:54:03Z', 'revision_number': 1, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:35Z', 'revision_number': 5, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:05.066144 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2de3c95e-7f2e-4b4a-8068-8b5bfbac5482 None None] The sync data for ids ['3f858ad2-b10f-4f04-9727-f99638a01796'] in dv-cinder-822278-1-iscsi is: [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': 'd1719efe-7c3d-4c2b-8a5a-91c7554f551c', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'floating_ip_address': '172.27.3.226', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'port_id': 'abed4d23-da46-4f59-9f36-c9fc12fcb192', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 93, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'mac_address': 'fa:16:3e:f1:9b:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e81aeaf1-e5dc-482f-b37d-b91f972dc6ff', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:53:35Z', 'updated_at': '2021-12-20T05:54:03Z', 'revision_number': 1, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:35Z', 'revision_number': 5, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:54:05.274088 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70b4f6fe-8e1b-4d7f-97f8-c3cf58dee7fe None None] New status for floating IP d1719efe-7c3d-4c2b-8a5a-91c7554f551c: ACTIVE {{(pid=102447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 05:54:05.493249 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3afd683-31e9-4e41-a6ea-adca718118e0 req-35fc0b84-7a12-4038-a1c4-26f899a7e418 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:05.494849 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d3afd683-31e9-4e41-a6ea-adca718118e0 req-35fc0b84-7a12-4038-a1c4-26f899a7e418 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1898b7c1b3dc4523b09a97486622c67e&device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 1098 time: 0.0496042 Dec 20 05:54:05.610442 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3afd683-31e9-4e41-a6ea-adca718118e0 req-7f827b76-8d9c-48ae-b7f9-fa9a2323b413 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:05.612432 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d3afd683-31e9-4e41-a6ea-adca718118e0 req-7f827b76-8d9c-48ae-b7f9-fa9a2323b413 service neutron] 10.222.0.54 "GET /v2.0/networks?id=6924a88e-10c1-4073-a41c-88aad14ebd0f HTTP/1.1" status: 200 len: 912 time: 0.1056335 Dec 20 05:54:05.725155 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d3afd683-31e9-4e41-a6ea-adca718118e0 req-f09a612f-e9bf-4754-8aaf-d37d0d183873 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=abed4d23-da46-4f59-9f36-c9fc12fcb192 HTTP/1.1" status: 200 len: 1001 time: 0.1055620 Dec 20 05:54:05.784480 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3afd683-31e9-4e41-a6ea-adca718118e0 req-1a6d810a-21c0-4c2d-b1ce-5947b8d3be2e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:05.786075 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d3afd683-31e9-4e41-a6ea-adca718118e0 req-1a6d810a-21c0-4c2d-b1ce-5947b8d3be2e service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ffb588f9-2ffb-4921-8a76-be5179c2fbed HTTP/1.1" status: 200 len: 850 time: 0.0521870 Dec 20 05:54:05.832312 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3afd683-31e9-4e41-a6ea-adca718118e0 req-3d7c1586-79c1-42c4-9787-84b1f3253742 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:05.833772 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d3afd683-31e9-4e41-a6ea-adca718118e0 req-3d7c1586-79c1-42c4-9787-84b1f3253742 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6924a88e-10c1-4073-a41c-88aad14ebd0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0401175 Dec 20 05:54:05.934928 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d3afd683-31e9-4e41-a6ea-adca718118e0 req-60d2d33b-d651-45e2-a7e3-8281d7d6982d service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0932908 Dec 20 05:54:06.037193 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d3afd683-31e9-4e41-a6ea-adca718118e0 req-9133fc11-159b-4645-8961-ed75e2e6ee34 service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0931489 Dec 20 05:54:06.451119 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:07.312174 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:07.565350 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.025209 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 42656) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:09.137502 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-050b13c6-5611-4faf-8477-a500d32d6b2c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.217895 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-050b13c6-5611-4faf-8477-a500d32d6b2c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.221616 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-050b13c6-5611-4faf-8477-a500d32d6b2c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.263820 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-050b13c6-5611-4faf-8477-a500d32d6b2c admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=71fe0cde5d534556bef2aed1809281bd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2375145 Dec 20 05:54:09.265446 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-050b13c6-5611-4faf-8477-a500d32d6b2c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bfba332d-47d2-416f-89ed-f1376579f94c,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:09.267065 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42668) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:09.317602 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7f031480-e75e-46b5-9c3a-ae7311ec7a8d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.331541 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 42670) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:09.338548 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7f031480-e75e-46b5-9c3a-ae7311ec7a8d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.384746 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7f031480-e75e-46b5-9c3a-ae7311ec7a8d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.387330 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7f031480-e75e-46b5-9c3a-ae7311ec7a8d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.388470 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-7f031480-e75e-46b5-9c3a-ae7311ec7a8d admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/bfba332d-47d2-416f-89ed-f1376579f94c HTTP/1.1" status: 204 len: 168 time: 0.1202784 Dec 20 05:54:09.401639 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f031480-e75e-46b5-9c3a-ae7311ec7a8d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bfba332d-47d2-416f-89ed-f1376579f94c,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:09.615626 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-10230d73-f868-481e-bd0a-47ed81a5474a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.669323 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42680) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:09.686691 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a7b622bd-893e-4b96-a041-562c8d0b31ef admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.704239 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-10230d73-f868-481e-bd0a-47ed81a5474a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.708926 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-10230d73-f868-481e-bd0a-47ed81a5474a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.759434 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10230d73-f868-481e-bd0a-47ed81a5474a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1cd2ff3-0ef5-4040-a4c1-f400d6cb1045,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:09.765368 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-10230d73-f868-481e-bd0a-47ed81a5474a admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=2f5dc9a39a994beeaf989f0776a0aa7d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4326730 Dec 20 05:54:09.768198 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42688) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:09.811590 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a7b622bd-893e-4b96-a041-562c8d0b31ef admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.819730 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a7b622bd-893e-4b96-a041-562c8d0b31ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.865518 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7b622bd-893e-4b96-a041-562c8d0b31ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3fbbbcae-14a8-49dc-a32b-b4afbef09590,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:09.882930 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 42696) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:09.883349 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-a7b622bd-893e-4b96-a041-562c8d0b31ef admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=3402d0ca0d8a4b7483cf0cd8022db328&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2122769 Dec 20 05:54:09.885436 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-75ca226c-e2e0-4b80-bdc9-ec7b1a3cef70 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.926372 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-75ca226c-e2e0-4b80-bdc9-ec7b1a3cef70 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.954008 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dc6cf990-6752-4b3a-b36a-93a81f0dab9d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.985961 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dc6cf990-6752-4b3a-b36a-93a81f0dab9d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.993428 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-75ca226c-e2e0-4b80-bdc9-ec7b1a3cef70 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:09.998766 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-75ca226c-e2e0-4b80-bdc9-ec7b1a3cef70 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:10.003399 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-75ca226c-e2e0-4b80-bdc9-ec7b1a3cef70 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/b1cd2ff3-0ef5-4040-a4c1-f400d6cb1045 HTTP/1.1" status: 204 len: 168 time: 0.2338064 Dec 20 05:54:10.023204 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75ca226c-e2e0-4b80-bdc9-ec7b1a3cef70 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1cd2ff3-0ef5-4040-a4c1-f400d6cb1045,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:10.065675 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dc6cf990-6752-4b3a-b36a-93a81f0dab9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:10.068576 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dc6cf990-6752-4b3a-b36a-93a81f0dab9d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:10.072031 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-dc6cf990-6752-4b3a-b36a-93a81f0dab9d admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/3fbbbcae-14a8-49dc-a32b-b4afbef09590 HTTP/1.1" status: 204 len: 168 time: 0.1878488 Dec 20 05:54:10.082814 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc6cf990-6752-4b3a-b36a-93a81f0dab9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3fbbbcae-14a8-49dc-a32b-b4afbef09590,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:10.445219 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 42736) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:10.458515 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d86ff76d-67c4-4488-85ac-2bcaa6db0498 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:10.558793 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d86ff76d-67c4-4488-85ac-2bcaa6db0498 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:10.563165 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d86ff76d-67c4-4488-85ac-2bcaa6db0498 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:10.577822 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42742) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:10.604793 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-d86ff76d-67c4-4488-85ac-2bcaa6db0498 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=75bbbccc3f5548bebf90f04f6f203ab5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1583426 Dec 20 05:54:10.605989 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d86ff76d-67c4-4488-85ac-2bcaa6db0498 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34b90759-c0cf-4563-92b6-604c775fb1d1,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:10.607469 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42746) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:10.660689 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c82306a7-1ed3-43e0-931d-6e36de59ff20 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:10.682304 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c82306a7-1ed3-43e0-931d-6e36de59ff20 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:10.703262 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5147673c-0bc0-437f-b045-bf9d59db3e68 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:10.774673 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c82306a7-1ed3-43e0-931d-6e36de59ff20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:10.777476 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c82306a7-1ed3-43e0-931d-6e36de59ff20 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:10.778764 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-c82306a7-1ed3-43e0-931d-6e36de59ff20 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/34b90759-c0cf-4563-92b6-604c775fb1d1 HTTP/1.1" status: 204 len: 168 time: 0.1697559 Dec 20 05:54:10.801821 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c82306a7-1ed3-43e0-931d-6e36de59ff20 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34b90759-c0cf-4563-92b6-604c775fb1d1,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:10.844598 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5147673c-0bc0-437f-b045-bf9d59db3e68 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:10.848654 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5147673c-0bc0-437f-b045-bf9d59db3e68 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:10.890145 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-5147673c-0bc0-437f-b045-bf9d59db3e68 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=c70a6823028e44318170198eef7a8e39&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3110969 Dec 20 05:54:10.892640 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5147673c-0bc0-437f-b045-bf9d59db3e68 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8fd7958e-2809-4de9-850f-12967396439d,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:10.893177 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 42762) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:10.942838 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-976f3b59-cf0a-4c15-9391-1ff302fc7544 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:10.967051 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-976f3b59-cf0a-4c15-9391-1ff302fc7544 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:11.031839 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-976f3b59-cf0a-4c15-9391-1ff302fc7544 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:11.035900 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-976f3b59-cf0a-4c15-9391-1ff302fc7544 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:11.037539 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-976f3b59-cf0a-4c15-9391-1ff302fc7544 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/8fd7958e-2809-4de9-850f-12967396439d HTTP/1.1" status: 204 len: 168 time: 0.1433659 Dec 20 05:54:11.048592 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-976f3b59-cf0a-4c15-9391-1ff302fc7544 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8fd7958e-2809-4de9-850f-12967396439d,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:11.432215 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 42790) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:11.448919 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-12a85986-568b-4fc8-9974-3adf80370bf1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:11.531208 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-12a85986-568b-4fc8-9974-3adf80370bf1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:11.536021 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-12a85986-568b-4fc8-9974-3adf80370bf1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:11.583428 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-12a85986-568b-4fc8-9974-3adf80370bf1 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=0bbc82637d164a768d24899977ee4c4a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1463406 Dec 20 05:54:11.583428 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12a85986-568b-4fc8-9974-3adf80370bf1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a41c8553-8f89-4bfd-9d19-2ed8426bfc13,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:11.583622 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42796) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:11.649364 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f7e9433b-629b-490a-9ad1-61a946963655 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:11.672647 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f7e9433b-629b-490a-9ad1-61a946963655 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:11.730330 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f7e9433b-629b-490a-9ad1-61a946963655 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:11.732983 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f7e9433b-629b-490a-9ad1-61a946963655 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:11.734132 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-f7e9433b-629b-490a-9ad1-61a946963655 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/a41c8553-8f89-4bfd-9d19-2ed8426bfc13 HTTP/1.1" status: 204 len: 168 time: 0.1498711 Dec 20 05:54:11.742635 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7e9433b-629b-490a-9ad1-61a946963655 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a41c8553-8f89-4bfd-9d19-2ed8426bfc13,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:12.210139 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42834) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:12.229207 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-98d35def-9c84-4d70-89d7-ec1f5413f3ad admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:12.315275 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-98d35def-9c84-4d70-89d7-ec1f5413f3ad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:12.320401 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-98d35def-9c84-4d70-89d7-ec1f5413f3ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:12.361731 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-98d35def-9c84-4d70-89d7-ec1f5413f3ad admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=27364a4e28e54188be56ff484c2af15e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1485255 Dec 20 05:54:12.362576 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 42840) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:12.362750 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98d35def-9c84-4d70-89d7-ec1f5413f3ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=694c43d9-c4f9-4269-9dd9-eb2eca08edb8,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:12.413354 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-0ef08548-419f-41dd-826f-6ad0223e428d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:12.434757 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-0ef08548-419f-41dd-826f-6ad0223e428d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:12.482666 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-0ef08548-419f-41dd-826f-6ad0223e428d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:12.485923 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-0ef08548-419f-41dd-826f-6ad0223e428d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:12.487047 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-0ef08548-419f-41dd-826f-6ad0223e428d admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/694c43d9-c4f9-4269-9dd9-eb2eca08edb8 HTTP/1.1" status: 204 len: 168 time: 0.1233995 Dec 20 05:54:12.494882 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ef08548-419f-41dd-826f-6ad0223e428d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=694c43d9-c4f9-4269-9dd9-eb2eca08edb8,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:13.184064 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 42896) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:13.294382 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-1ac86a77-9914-4bf1-871f-206ff463b753 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:13.368336 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-1ac86a77-9914-4bf1-871f-206ff463b753 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:13.372388 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-1ac86a77-9914-4bf1-871f-206ff463b753 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:13.402308 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42910) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:13.403304 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-1ac86a77-9914-4bf1-871f-206ff463b753 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=ec9a7b80f55342dba424a5ada6290fa8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2180653 Dec 20 05:54:13.428330 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ac86a77-9914-4bf1-871f-206ff463b753 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=58fdfff0-4137-4805-b568-08d75b428206,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:13.460480 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d5e4934e-813b-4bc4-811e-9ed9bdc6a583 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:13.485612 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d5e4934e-813b-4bc4-811e-9ed9bdc6a583 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:13.536453 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d5e4934e-813b-4bc4-811e-9ed9bdc6a583 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:13.539257 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d5e4934e-813b-4bc4-811e-9ed9bdc6a583 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:13.543212 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-d5e4934e-813b-4bc4-811e-9ed9bdc6a583 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/58fdfff0-4137-4805-b568-08d75b428206 HTTP/1.1" status: 204 len: 168 time: 0.1377089 Dec 20 05:54:13.548812 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5e4934e-813b-4bc4-811e-9ed9bdc6a583 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=58fdfff0-4137-4805-b568-08d75b428206,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:13.834491 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42920) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:13.848381 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-797b21ad-ad32-4b2f-ace4-73952ded370e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:13.923325 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-797b21ad-ad32-4b2f-ace4-73952ded370e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:13.926978 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-797b21ad-ad32-4b2f-ace4-73952ded370e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:13.964545 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-797b21ad-ad32-4b2f-ace4-73952ded370e admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=80be7031c74f4495aa00397a2df9c895&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1266170 Dec 20 05:54:13.965254 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 42924) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:13.966999 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-797b21ad-ad32-4b2f-ace4-73952ded370e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a80b17c-f639-480b-ba44-bf27dda86f3e,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:14.017232 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-18fce9fe-733d-418f-b566-dea47306f5a6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:14.038114 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-18fce9fe-733d-418f-b566-dea47306f5a6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:14.085105 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-18fce9fe-733d-418f-b566-dea47306f5a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:14.088148 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-18fce9fe-733d-418f-b566-dea47306f5a6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:14.089254 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-18fce9fe-733d-418f-b566-dea47306f5a6 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/9a80b17c-f639-480b-ba44-bf27dda86f3e HTTP/1.1" status: 204 len: 168 time: 0.1226201 Dec 20 05:54:14.097192 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18fce9fe-733d-418f-b566-dea47306f5a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a80b17c-f639-480b-ba44-bf27dda86f3e,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:14.795676 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 42980) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:15.021352 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f058f4d2-88e9-42f1-a0fa-f321896ccadc admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.101541 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f058f4d2-88e9-42f1-a0fa-f321896ccadc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.105127 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f058f4d2-88e9-42f1-a0fa-f321896ccadc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.142506 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-f058f4d2-88e9-42f1-a0fa-f321896ccadc admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=b41f362116194dc5938e47ec703870df&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3457484 Dec 20 05:54:15.143628 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f058f4d2-88e9-42f1-a0fa-f321896ccadc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=467aabcc-8211-4c52-9b0d-de10125baea3,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:15.147605 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 42996) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:15.197756 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e2f3ee2-3fd3-4048-ba20-c42355e7d2f8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.219694 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e2f3ee2-3fd3-4048-ba20-c42355e7d2f8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.242388 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 43002) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:15.270803 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e2f3ee2-3fd3-4048-ba20-c42355e7d2f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.273634 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e2f3ee2-3fd3-4048-ba20-c42355e7d2f8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.277553 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-8e2f3ee2-3fd3-4048-ba20-c42355e7d2f8 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/467aabcc-8211-4c52-9b0d-de10125baea3 HTTP/1.1" status: 204 len: 168 time: 0.1261551 Dec 20 05:54:15.293266 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e2f3ee2-3fd3-4048-ba20-c42355e7d2f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=467aabcc-8211-4c52-9b0d-de10125baea3,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:15.368440 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-16ee1b8d-8f5b-4f50-8860-a812edd494a6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.454744 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-16ee1b8d-8f5b-4f50-8860-a812edd494a6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.461657 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-16ee1b8d-8f5b-4f50-8860-a812edd494a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.529119 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 43018) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:15.529401 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-16ee1b8d-8f5b-4f50-8860-a812edd494a6 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=3badea14d6154d0e9bee05b42ea4b3d3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2856905 Dec 20 05:54:15.530698 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16ee1b8d-8f5b-4f50-8860-a812edd494a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d749451f-9338-4bc6-9518-194ec22bf4c1,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:15.647564 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f61486a6-a37d-4561-a1a6-da7b322b8204 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.676449 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f61486a6-a37d-4561-a1a6-da7b322b8204 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.726183 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 43032) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:15.736822 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f61486a6-a37d-4561-a1a6-da7b322b8204 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.741778 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f6a662fe-98cb-486d-9315-ecfbb38f03ab admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.741952 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f61486a6-a37d-4561-a1a6-da7b322b8204 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.745875 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-f61486a6-a37d-4561-a1a6-da7b322b8204 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/d749451f-9338-4bc6-9518-194ec22bf4c1 HTTP/1.1" status: 204 len: 168 time: 0.2122359 Dec 20 05:54:15.764210 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f61486a6-a37d-4561-a1a6-da7b322b8204 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d749451f-9338-4bc6-9518-194ec22bf4c1,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:15.860308 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f6a662fe-98cb-486d-9315-ecfbb38f03ab admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.866508 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-f6a662fe-98cb-486d-9315-ecfbb38f03ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:15.910836 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 43042) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:15.923919 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-f6a662fe-98cb-486d-9315-ecfbb38f03ab admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=395e6af81f624463a76ae52d438e18b8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1965897 Dec 20 05:54:15.925894 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6a662fe-98cb-486d-9315-ecfbb38f03ab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7aa7d153-7823-4f08-9034-edca070a5a38,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:15.926892 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 43046) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:15.977929 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-718cea72-b6e8-4c88-b6a0-78c1b8c1834b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.006581 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-718cea72-b6e8-4c88-b6a0-78c1b8c1834b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.068344 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-718cea72-b6e8-4c88-b6a0-78c1b8c1834b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.074148 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-718cea72-b6e8-4c88-b6a0-78c1b8c1834b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.075291 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-718cea72-b6e8-4c88-b6a0-78c1b8c1834b admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/7aa7d153-7823-4f08-9034-edca070a5a38 HTTP/1.1" status: 204 len: 168 time: 0.1474555 Dec 20 05:54:16.083474 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-718cea72-b6e8-4c88-b6a0-78c1b8c1834b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7aa7d153-7823-4f08-9034-edca070a5a38,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:16.165372 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-86047e34-d346-44cb-ba46-ce4678dfd0a9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.244383 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-86047e34-d346-44cb-ba46-ce4678dfd0a9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.249460 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-86047e34-d346-44cb-ba46-ce4678dfd0a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.289027 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-86047e34-d346-44cb-ba46-ce4678dfd0a9 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=811a40ea1e0845cb828091b906cf3187&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3731813 Dec 20 05:54:16.289387 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 43062) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:16.297729 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86047e34-d346-44cb-ba46-ce4678dfd0a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=030e144f-11e0-48d3-b008-0e7c0acc281c,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:16.342906 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-692929e2-883c-4922-9a2a-2d25e20cdbcd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.370189 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-692929e2-883c-4922-9a2a-2d25e20cdbcd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.422876 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-692929e2-883c-4922-9a2a-2d25e20cdbcd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.425566 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-692929e2-883c-4922-9a2a-2d25e20cdbcd admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.426882 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-692929e2-883c-4922-9a2a-2d25e20cdbcd admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/030e144f-11e0-48d3-b008-0e7c0acc281c HTTP/1.1" status: 204 len: 168 time: 0.1367393 Dec 20 05:54:16.434884 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-692929e2-883c-4922-9a2a-2d25e20cdbcd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=030e144f-11e0-48d3-b008-0e7c0acc281c,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:16.469086 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 43068) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:16.486171 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-02267366-bb05-4242-80a2-321b3baf462b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.580784 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-02267366-bb05-4242-80a2-321b3baf462b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.590403 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-02267366-bb05-4242-80a2-321b3baf462b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.639768 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-02267366-bb05-4242-80a2-321b3baf462b admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=1c8ee4cbc4654a16b644f103081443fd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1657393 Dec 20 05:54:16.639945 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 43074) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:16.647486 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02267366-bb05-4242-80a2-321b3baf462b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4636c562-edc8-4be2-90da-8e6dfe82dd9e,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:16.719088 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-75cf4fa4-1b65-4757-9f2a-5499f1398228 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.743601 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-75cf4fa4-1b65-4757-9f2a-5499f1398228 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.797550 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-75cf4fa4-1b65-4757-9f2a-5499f1398228 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.801226 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-75cf4fa4-1b65-4757-9f2a-5499f1398228 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:16.802483 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-75cf4fa4-1b65-4757-9f2a-5499f1398228 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/4636c562-edc8-4be2-90da-8e6dfe82dd9e HTTP/1.1" status: 204 len: 168 time: 0.1614423 Dec 20 05:54:16.810472 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75cf4fa4-1b65-4757-9f2a-5499f1398228 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4636c562-edc8-4be2-90da-8e6dfe82dd9e,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:26.937500 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496ce6d5-c5e7-4d19-8935-446bb669501e req-18543bf3-11d6-4897-8e2b-b39f7d9d08ee tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:26.939047 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-496ce6d5-c5e7-4d19-8935-446bb669501e req-18543bf3-11d6-4897-8e2b-b39f7d9d08ee tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0482056 Dec 20 05:54:26.985754 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-496ce6d5-c5e7-4d19-8935-446bb669501e req-7da751f0-fe31-4544-92b0-a8e789f33b3c tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408914 Dec 20 05:54:28.101823 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b84f5d5e-1b24-4c09-8c45-a1c3cdf2566f req-faf03003-9a82-43c7-9670-5fe5ba613765 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:28.103259 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b84f5d5e-1b24-4c09-8c45-a1c3cdf2566f req-faf03003-9a82-43c7-9670-5fe5ba613765 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0499287 Dec 20 05:54:28.147729 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b84f5d5e-1b24-4c09-8c45-a1c3cdf2566f req-bde1ba4a-0da0-4697-b764-890755a6e825 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385628 Dec 20 05:54:29.262887 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aea81cd-409b-4a8d-be29-74a55fcce352 req-257a093f-042f-4b81-9598-5e011f4a4087 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:29.264935 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0aea81cd-409b-4a8d-be29-74a55fcce352 req-257a093f-042f-4b81-9598-5e011f4a4087 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0482728 Dec 20 05:54:29.312549 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0aea81cd-409b-4a8d-be29-74a55fcce352 req-05ad1191-c9de-420a-9b17-344d0adcc877 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416956 Dec 20 05:54:30.427501 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1913b155-bae4-4391-8ec4-8670b33ffcbf req-ecaa2918-be26-4a97-a8f8-6b1e4aeaae9f tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:30.429028 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1913b155-bae4-4391-8ec4-8670b33ffcbf req-ecaa2918-be26-4a97-a8f8-6b1e4aeaae9f tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0485752 Dec 20 05:54:30.484833 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1913b155-bae4-4391-8ec4-8670b33ffcbf req-5d26cafa-24fa-4a84-84b7-287663cc16ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485857 Dec 20 05:54:31.610360 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb21315-07e0-448c-b6bc-e553f4dee01a req-d1e582d1-448e-426f-9b9d-b3524accac91 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:31.611851 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-acb21315-07e0-448c-b6bc-e553f4dee01a req-d1e582d1-448e-426f-9b9d-b3524accac91 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0540934 Dec 20 05:54:31.668607 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-acb21315-07e0-448c-b6bc-e553f4dee01a req-792ec1bb-6812-4354-ad15-ebbe4773b291 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459783 Dec 20 05:54:31.705329 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-a7dd783f-03f6-4f30-bcf1-641c24988baf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:31.970166 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:54:32.780809 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f51abf8e-f8f3-47b0-8ca2-5bc7ab63b1f6 req-52443d49-1e0e-4993-97ae-5f54ae8b9a73 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:32.782374 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f51abf8e-f8f3-47b0-8ca2-5bc7ab63b1f6 req-52443d49-1e0e-4993-97ae-5f54ae8b9a73 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0473731 Dec 20 05:54:32.828417 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f51abf8e-f8f3-47b0-8ca2-5bc7ab63b1f6 req-026dbe9a-1ecd-4f05-a12a-4e8545f140b9 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399134 Dec 20 05:54:33.978102 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf8bb739-cb60-49c4-b824-4e85bbc9abd8 req-a16d0eb7-d385-4ffb-ae7b-e33d228cda9b tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:33.979541 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bf8bb739-cb60-49c4-b824-4e85bbc9abd8 req-a16d0eb7-d385-4ffb-ae7b-e33d228cda9b tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0495415 Dec 20 05:54:34.025058 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bf8bb739-cb60-49c4-b824-4e85bbc9abd8 req-9a8bfa2d-4e89-400f-b282-0ea525dd7121 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389364 Dec 20 05:54:34.158605 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-1d7d0448-bfd3-4344-9c05-5621c9b56f1c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:34.184393 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c5e17288-4d9f-447e-892b-3dead3b55623 req-a6b6fc1f-6f0b-4b63-9cf1-5629b2ea652e service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0469131 Dec 20 05:54:34.306146 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e17288-4d9f-447e-892b-3dead3b55623 req-ed13c56a-2cfa-4e7e-942b-8837b4702c54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:34.307775 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c5e17288-4d9f-447e-892b-3dead3b55623 req-ed13c56a-2cfa-4e7e-942b-8837b4702c54 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1898b7c1b3dc4523b09a97486622c67e&device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 1098 time: 0.0462613 Dec 20 05:54:34.433596 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e17288-4d9f-447e-892b-3dead3b55623 req-8712aad6-5f85-4796-a814-7555983943a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:34.435606 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c5e17288-4d9f-447e-892b-3dead3b55623 req-8712aad6-5f85-4796-a814-7555983943a9 service neutron] 10.222.0.54 "GET /v2.0/networks?id=6924a88e-10c1-4073-a41c-88aad14ebd0f HTTP/1.1" status: 200 len: 912 time: 0.1033192 Dec 20 05:54:34.505564 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c5e17288-4d9f-447e-892b-3dead3b55623 req-89ba87ca-2f35-4918-a3b0-6e7288b944cb service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=abed4d23-da46-4f59-9f36-c9fc12fcb192 HTTP/1.1" status: 200 len: 1001 time: 0.0599329 Dec 20 05:54:34.609097 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e17288-4d9f-447e-892b-3dead3b55623 req-5b4a484f-2d2f-460d-9f80-5a89f6f50235 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:34.610608 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c5e17288-4d9f-447e-892b-3dead3b55623 req-5b4a484f-2d2f-460d-9f80-5a89f6f50235 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ffb588f9-2ffb-4921-8a76-be5179c2fbed HTTP/1.1" status: 200 len: 850 time: 0.0491307 Dec 20 05:54:34.656954 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e17288-4d9f-447e-892b-3dead3b55623 req-7bb76cd1-7ffd-48f1-af16-8d74bd4bd1eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:34.658418 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c5e17288-4d9f-447e-892b-3dead3b55623 req-7bb76cd1-7ffd-48f1-af16-8d74bd4bd1eb service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6924a88e-10c1-4073-a41c-88aad14ebd0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0400314 Dec 20 05:54:34.755937 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c5e17288-4d9f-447e-892b-3dead3b55623 req-96ec4126-c0e9-46c1-8a05-1f3815e12ada service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895369 Dec 20 05:54:34.972925 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:35.146493 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30264301-69d3-4d3a-b7f6-3c7fdd859c52 req-7ae119aa-0a98-48d1-a50b-116984d6aed1 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:35.148020 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-30264301-69d3-4d3a-b7f6-3c7fdd859c52 req-7ae119aa-0a98-48d1-a50b-116984d6aed1 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0536766 Dec 20 05:54:35.203047 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-30264301-69d3-4d3a-b7f6-3c7fdd859c52 req-ba91b32a-9fc9-45dd-abbb-0358ae9f3118 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441141 Dec 20 05:54:36.314954 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05416276-2fe3-4bfa-b90c-1deda69948b5 req-f5fb2acb-3877-4da6-b155-f677b09b0786 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:36.316447 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-05416276-2fe3-4bfa-b90c-1deda69948b5 req-f5fb2acb-3877-4da6-b155-f677b09b0786 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0479569 Dec 20 05:54:36.362528 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-05416276-2fe3-4bfa-b90c-1deda69948b5 req-3e68b83e-a616-475f-aeee-552ba2e8c3a0 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403116 Dec 20 05:54:36.454163 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:37.311907 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:37.491345 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-105b9408-7c3e-49fe-9db0-ba1ae6725e59 req-1c2b4de2-6a27-4333-be56-f8fd25226d33 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:37.492739 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-105b9408-7c3e-49fe-9db0-ba1ae6725e59 req-1c2b4de2-6a27-4333-be56-f8fd25226d33 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0509689 Dec 20 05:54:37.543350 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-105b9408-7c3e-49fe-9db0-ba1ae6725e59 req-c04a8090-a887-4a70-a586-7f9dda2f0cca tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443623 Dec 20 05:54:37.567316 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:37.903770 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c5e17288-4d9f-447e-892b-3dead3b55623 req-3cca4e10-9224-4703-9e2c-218c3ed6eb52 service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842748 Dec 20 05:54:38.673140 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5064d43b-4b84-4a85-a2c0-c2a785614909 req-4d54a90e-aacd-4e79-95be-911a790cc1e8 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:38.674598 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5064d43b-4b84-4a85-a2c0-c2a785614909 req-4d54a90e-aacd-4e79-95be-911a790cc1e8 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0522828 Dec 20 05:54:38.720968 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5064d43b-4b84-4a85-a2c0-c2a785614909 req-c7277680-7448-4ff3-9605-274fe92f1af4 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403233 Dec 20 05:54:39.848332 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65aebf8e-2d15-4f3a-bbc9-6baf1155813f req-847921a5-2766-4ec3-b181-f4f059baf38c tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:39.850767 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-65aebf8e-2d15-4f3a-bbc9-6baf1155813f req-847921a5-2766-4ec3-b181-f4f059baf38c tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0514667 Dec 20 05:54:39.902205 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-65aebf8e-2d15-4f3a-bbc9-6baf1155813f req-b05b42fd-a48e-447c-99f9-09f1a59cb5ef tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401902 Dec 20 05:54:41.017460 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68dff3af-20a6-4229-ac6a-02c16171b70e req-ec00b6be-d24a-4dfa-af70-8e79dffbfd6f tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:41.018900 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-68dff3af-20a6-4229-ac6a-02c16171b70e req-ec00b6be-d24a-4dfa-af70-8e79dffbfd6f tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0471568 Dec 20 05:54:41.067504 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-68dff3af-20a6-4229-ac6a-02c16171b70e req-14e966a0-fd5d-4fda-993f-d1b0f73dfd53 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428679 Dec 20 05:54:41.918420 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8f1735-369c-43d0-9a6a-0149bca9c178 req-862a30e4-594c-41f2-b3a7-e11064d353e2 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:41.920472 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8b8f1735-369c-43d0-9a6a-0149bca9c178 req-862a30e4-594c-41f2-b3a7-e11064d353e2 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.54 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.0495682 Dec 20 05:54:42.049400 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-8b8f1735-369c-43d0-9a6a-0149bca9c178 req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Deleting port 04f78e54-1e12-4575-b3c2-165c19e74def {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:54:42.050022 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-8b8f1735-369c-43d0-9a6a-0149bca9c178 req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:42.161105 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-8b8f1735-369c-43d0-9a6a-0149bca9c178 req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] For port 04f78e54-1e12-4575-b3c2-165c19e74def, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=04f78e54-1e12-4575-b3c2-165c19e74def,segment=NetworkSegment(bb43682f-2240-467e-b9ff-f7edf582b7d1),segment_id=bb43682f-2240-467e-b9ff-f7edf582b7d1)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:54:42.161456 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-8b8f1735-369c-43d0-9a6a-0149bca9c178 req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:42.194459 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-8b8f1735-369c-43d0-9a6a-0149bca9c178 req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Calling delete_port for 04f78e54-1e12-4575-b3c2-165c19e74def owned by compute:nova {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:54:42.272212 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3708c073-5e96-4c56-976c-d81c6cc8708f req-3013211f-5c6e-448a-8c3b-ffd8c2f450dd tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:42.273417 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3708c073-5e96-4c56-976c-d81c6cc8708f req-3013211f-5c6e-448a-8c3b-ffd8c2f450dd tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 945 time: 0.1282218 Dec 20 05:54:42.351968 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3708c073-5e96-4c56-976c-d81c6cc8708f req-4c2e5a2a-42d1-4ec3-bf09-804d67bed4c7 tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/security-groups?id=2c6b7a99-e092-41e3-8114-c4404723cbd0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703654 Dec 20 05:54:42.416236 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-8b8f1735-369c-43d0-9a6a-0149bca9c178 req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:42.445569 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Pushing event deleted for resources: {'Port': ['ID=04f78e54-1e12-4575-b3c2-165c19e74def,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:42.464067 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:42.464067 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:42.464464 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:42.464802 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:42.465133 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:42.465461 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:42.465788 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:42.466174 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:42.466634 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:42.466925 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:42.467241 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:42.467726 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:42.468011 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:42.538515 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-8b8f1735-369c-43d0-9a6a-0149bca9c178 req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] No DVR routers for this DVR port 04f78e54-1e12-4575-b3c2-165c19e74def on host hv-cinder-82227 {{(pid=102445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 05:54:42.541713 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-8b8f1735-369c-43d0-9a6a-0149bca9c178 req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:42.545611 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8b8f1735-369c-43d0-9a6a-0149bca9c178 req-1370c029-a896-4778-8a22-198b414987ce tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.54 "DELETE /v2.0/ports/04f78e54-1e12-4575-b3c2-165c19e74def HTTP/1.1" status: 204 len: 173 time: 0.6182175 Dec 20 05:54:42.546463 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3c23e2c6-db4c-4766-8571-6e612c92168e', 'name': 'network-vif-deleted', 'tag': '04f78e54-1e12-4575-b3c2-165c19e74def'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:54:42.549284 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b9d35784-56d6-4284-a67c-533ec053e288" -d '{"events": [{"server_uuid": "3c23e2c6-db4c-4766-8571-6e612c92168e", "name": "network-vif-deleted", "tag": "04f78e54-1e12-4575-b3c2-165c19e74def"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:54:42.599933 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:54:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cb471c1d-eba1-4114-8332-f6ea15c16f74 x-openstack-request-id: req-cb471c1d-eba1-4114-8332-f6ea15c16f74 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:54:42.600328 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3c23e2c6-db4c-4766-8571-6e612c92168e", "name": "network-vif-deleted", "tag": "04f78e54-1e12-4575-b3c2-165c19e74def", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:54:42.600682 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-cb471c1d-eba1-4114-8332-f6ea15c16f74 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:54:42.601271 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3c23e2c6-db4c-4766-8571-6e612c92168e', 'name': 'network-vif-deleted', 'tag': '04f78e54-1e12-4575-b3c2-165c19e74def', 'status': 'completed', 'code': 200} Dec 20 05:54:42.731577 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 04f78e54-1e12-4575-b3c2-165c19e74def no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:54:42.752250 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: 04f78e54-1e12-4575-b3c2-165c19e74def {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:54:42.752602 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 04f78e54-1e12-4575-b3c2-165c19e74def not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:54:43.490377 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-14eab18b-b104-41ca-9093-0c7708d1c742 req-1af42ad6-4158-40d3-a7b2-dca1363a9a1a tempest-DeleteServersTestJSON-1566505224 tempest-DeleteServersTestJSON-1566505224-project] 10.222.0.46 "GET /v2.0/ports?device_id=3c23e2c6-db4c-4766-8571-6e612c92168e HTTP/1.1" status: 200 len: 210 time: 0.0265019 Dec 20 05:54:44.542370 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 43806) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:44.610618 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_v2 [None req-d568a5bf-d325-4338-bf4d-e5cbb954d1d4 admin admin] Deleting subnet 06ed926b-b87a-4029-96f3-a2c1ccb7d6a8 {{(pid=102445) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 05:54:44.614095 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d568a5bf-d325-4338-bf4d-e5cbb954d1d4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:44.661265 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d568a5bf-d325-4338-bf4d-e5cbb954d1d4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3457727'] for subnet, precommit_delete_associations {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:44.712156 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d568a5bf-d325-4338-bf4d-e5cbb954d1d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:44.772192 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d568a5bf-d325-4338-bf4d-e5cbb954d1d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3465107', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3597782'] for subnet, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:44.799058 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d568a5bf-d325-4338-bf4d-e5cbb954d1d4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=06ed926b-b87a-4029-96f3-a2c1ccb7d6a8,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:44.810378 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d568a5bf-d325-4338-bf4d-e5cbb954d1d4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:44.817472 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-d568a5bf-d325-4338-bf4d-e5cbb954d1d4 admin admin] 10.222.0.46 "DELETE /v2.0/subnets/06ed926b-b87a-4029-96f3-a2c1ccb7d6a8 HTTP/1.1" status: 204 len: 168 time: 0.2723849 Dec 20 05:54:44.817724 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 43826) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:44.895305 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8aae3788-741c-4b5b-a946-67a6ecafc472 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:44.982350 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8aae3788-741c-4b5b-a946-67a6ecafc472 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.005919 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-8aae3788-741c-4b5b-a946-67a6ecafc472 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d7623a03-8fb7-4995-aaba-531582991739']}} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:45.016009 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-8aae3788-741c-4b5b-a946-67a6ecafc472 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9888abfe-4264-4a19-a32b-176574ac7c6c') {'for_net_delete': True} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:45.016298 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-8aae3788-741c-4b5b-a946-67a6ecafc472 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9888abfe-4264-4a19-a32b-176574ac7c6c') {} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:45.025777 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8aae3788-741c-4b5b-a946-67a6ecafc472 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3457718'] for segment, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.040284 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8aae3788-741c-4b5b-a946-67a6ecafc472 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.054294 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8aae3788-741c-4b5b-a946-67a6ecafc472 admin admin] Releasing vlan 435 on physical network physnet1 to pool {{(pid=102445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 05:54:45.054693 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8aae3788-741c-4b5b-a946-67a6ecafc472 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3465205'] for segment, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: Traceback (most recent call last): Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: timer() Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: cb(*args, **kw) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: return func(*args, **kwargs) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: self._notify() Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: self.callback(batched_events) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: event.method(event) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: return f(self, *a, **k) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._get(url).json() Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: return self.request(url, 'GET', **kwargs) Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 05:54:45.056664 dv-cinder-822278-1-iscsi neutron-server[102445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 05:54:45.060795 dv-cinder-822278-1-iscsi neutron-server[102445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 05:54:45.118035 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8aae3788-741c-4b5b-a946-67a6ecafc472 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.133350 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8aae3788-741c-4b5b-a946-67a6ecafc472 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.136570 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-8aae3788-741c-4b5b-a946-67a6ecafc472 admin admin] 10.222.0.46 "DELETE /v2.0/networks/d7623a03-8fb7-4995-aaba-531582991739 HTTP/1.1" status: 204 len: 168 time: 0.3178723 Dec 20 05:54:45.137557 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aae3788-741c-4b5b-a946-67a6ecafc472 admin admin] Pushing event deleted for resources: {'Network': ['ID=d7623a03-8fb7-4995-aaba-531582991739,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:45.140420 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 43842) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:45.183331 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_v2 [None req-015e5fa7-9f30-475f-828d-9fc98d12d231 admin admin] Deleting subnet 7a43f95c-34f3-4424-b721-2bdfcd28309f {{(pid=102445) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 05:54:45.187122 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-015e5fa7-9f30-475f-828d-9fc98d12d231 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.221669 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-015e5fa7-9f30-475f-828d-9fc98d12d231 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3457727'] for subnet, precommit_delete_associations {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.263522 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-015e5fa7-9f30-475f-828d-9fc98d12d231 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.313301 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-015e5fa7-9f30-475f-828d-9fc98d12d231 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3465107', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3597782'] for subnet, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.337223 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-015e5fa7-9f30-475f-828d-9fc98d12d231 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7a43f95c-34f3-4424-b721-2bdfcd28309f,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:45.340957 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-015e5fa7-9f30-475f-828d-9fc98d12d231 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.345606 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-015e5fa7-9f30-475f-828d-9fc98d12d231 admin admin] 10.222.0.46 "DELETE /v2.0/subnets/7a43f95c-34f3-4424-b721-2bdfcd28309f HTTP/1.1" status: 204 len: 168 time: 0.2045567 Dec 20 05:54:45.349988 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 43848) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:45.416426 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-71663960-0613-41d1-b82d-80dc9198fd68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.493659 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-71663960-0613-41d1-b82d-80dc9198fd68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.511931 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-71663960-0613-41d1-b82d-80dc9198fd68 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4f8d634b-43c9-489e-b019-103f56ae0bef']}} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:45.521107 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-71663960-0613-41d1-b82d-80dc9198fd68 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '57275fcb-7877-4aad-a636-7006fa81785e') {'for_net_delete': True} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:45.521402 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-71663960-0613-41d1-b82d-80dc9198fd68 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '57275fcb-7877-4aad-a636-7006fa81785e') {} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:45.530708 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-71663960-0613-41d1-b82d-80dc9198fd68 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3457718'] for segment, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.543743 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-71663960-0613-41d1-b82d-80dc9198fd68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.549588 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-71663960-0613-41d1-b82d-80dc9198fd68 admin admin] Releasing vlan 421 on physical network physnet1 to pool {{(pid=102445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 05:54:45.550021 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-71663960-0613-41d1-b82d-80dc9198fd68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3465205'] for segment, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: Traceback (most recent call last): Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: timer() Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: cb(*args, **kw) Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: return func(*args, **kwargs) Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: self._notify() Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: self.callback(batched_events) Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: event.method(event) Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: return f(self, *a, **k) Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._get(url).json() Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: return self.request(url, 'GET', **kwargs) Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 05:54:45.552089 dv-cinder-822278-1-iscsi neutron-server[102445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 05:54:45.613589 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-71663960-0613-41d1-b82d-80dc9198fd68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.618965 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-71663960-0613-41d1-b82d-80dc9198fd68 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.623052 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-71663960-0613-41d1-b82d-80dc9198fd68 admin admin] 10.222.0.46 "DELETE /v2.0/networks/4f8d634b-43c9-489e-b019-103f56ae0bef HTTP/1.1" status: 204 len: 168 time: 0.2721460 Dec 20 05:54:45.634639 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71663960-0613-41d1-b82d-80dc9198fd68 admin admin] Pushing event deleted for resources: {'Network': ['ID=4f8d634b-43c9-489e-b019-103f56ae0bef,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:45.789625 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 43860) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:45.835608 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-11b2fddd-e82f-4f3b-a085-15662582b0be admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=8c63fd9e08834fa5b16c3ee09e6a5bb6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0425568 Dec 20 05:54:45.835922 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 43866) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:45.874399 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 43870) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:45.886600 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.915596 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.965258 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.967918 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:45.971326 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/0e49658f-5032-4765-b991-cff1d0290cf1 HTTP/1.1" status: 204 len: 168 time: 0.1322024 Dec 20 05:54:45.976971 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e49658f-5032-4765-b991-cff1d0290cf1,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:45.992051 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:45.992944 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:45.993191 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:45.993820 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:45.994164 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:45.994544 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:45.994925 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:45.995223 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:45.995598 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:45.995949 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:45.996277 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:45.996597 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:45.997135 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f184bac8-6f68-4423-bb28-e3fdec8b736c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:46.004760 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-05ed9ff9-ac16-410c-bd4f-bd8c934fc7c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.101932 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-05ed9ff9-ac16-410c-bd4f-bd8c934fc7c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.107838 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-05ed9ff9-ac16-410c-bd4f-bd8c934fc7c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.146359 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05ed9ff9-ac16-410c-bd4f-bd8c934fc7c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7443078-2dd9-4a7c-8a74-148070116ad0,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:46.154849 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-05ed9ff9-ac16-410c-bd4f-bd8c934fc7c2 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=314a721f47e14b69aa35c724b79a11ef&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2763140 Dec 20 05:54:46.155317 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 43886) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:46.163206 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 43888) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:46.211941 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-426badbf-bef5-4769-8747-564bf84eea7c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.236254 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-426badbf-bef5-4769-8747-564bf84eea7c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.297587 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-23f9f9b2-82ef-4804-8b48-35dd9179085e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.305083 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-426badbf-bef5-4769-8747-564bf84eea7c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.307749 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-426badbf-bef5-4769-8747-564bf84eea7c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.308978 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-426badbf-bef5-4769-8747-564bf84eea7c admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/d7443078-2dd9-4a7c-8a74-148070116ad0 HTTP/1.1" status: 204 len: 168 time: 0.1523066 Dec 20 05:54:46.333593 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-426badbf-bef5-4769-8747-564bf84eea7c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7443078-2dd9-4a7c-8a74-148070116ad0,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:46.346998 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 43898) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:46.406536 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-7e0ed64d-b9af-43c3-be30-8c741df5a961 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=4f9a8a9f582a4b6a85e260fe47c03fe7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0581782 Dec 20 05:54:46.409512 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 43900) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:46.428369 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-23f9f9b2-82ef-4804-8b48-35dd9179085e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.432653 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-23f9f9b2-82ef-4804-8b48-35dd9179085e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.461159 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d64977bd-4586-437d-9f6a-cdee927ab288 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.465892 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-23f9f9b2-82ef-4804-8b48-35dd9179085e admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=1cb93276538f446d8047ed9198087d4b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3015628 Dec 20 05:54:46.468808 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 43904) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:46.482392 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d64977bd-4586-437d-9f6a-cdee927ab288 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.490778 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23f9f9b2-82ef-4804-8b48-35dd9179085e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c6ffcf48-e6be-4418-9963-5913b5cb7398,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:46.529509 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-04a056c9-5c9a-4456-99ae-4dd63849c52a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.536661 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d64977bd-4586-437d-9f6a-cdee927ab288 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.539316 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d64977bd-4586-437d-9f6a-cdee927ab288 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.540555 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-d64977bd-4586-437d-9f6a-cdee927ab288 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/7a7f423d-f917-4cfe-b599-4f40def310da HTTP/1.1" status: 204 len: 168 time: 0.1296906 Dec 20 05:54:46.551133 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d64977bd-4586-437d-9f6a-cdee927ab288 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a7f423d-f917-4cfe-b599-4f40def310da,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:46.554949 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-04a056c9-5c9a-4456-99ae-4dd63849c52a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.616461 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-04a056c9-5c9a-4456-99ae-4dd63849c52a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.619420 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-04a056c9-5c9a-4456-99ae-4dd63849c52a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.620649 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-04a056c9-5c9a-4456-99ae-4dd63849c52a admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/c6ffcf48-e6be-4418-9963-5913b5cb7398 HTTP/1.1" status: 204 len: 168 time: 0.1509447 Dec 20 05:54:46.631574 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04a056c9-5c9a-4456-99ae-4dd63849c52a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c6ffcf48-e6be-4418-9963-5913b5cb7398,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:46.694429 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 43910) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:46.708405 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fd3d666a-dbe4-4ba6-86ec-995e9f8e9542 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.787633 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fd3d666a-dbe4-4ba6-86ec-995e9f8e9542 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.792409 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fd3d666a-dbe4-4ba6-86ec-995e9f8e9542 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.834998 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-fd3d666a-dbe4-4ba6-86ec-995e9f8e9542 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=915d208abda44fcea5045bfccfba0f63&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1394939 Dec 20 05:54:46.835841 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd3d666a-dbe4-4ba6-86ec-995e9f8e9542 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6a9c1141-39ad-4b94-b761-fb68d583b749,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:46.837709 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 43918) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:46.891268 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3c599f9b-bc42-4d71-8ba4-1da47c4ebe9f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.915345 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3c599f9b-bc42-4d71-8ba4-1da47c4ebe9f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.968671 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3c599f9b-bc42-4d71-8ba4-1da47c4ebe9f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.973545 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3c599f9b-bc42-4d71-8ba4-1da47c4ebe9f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:46.977193 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-3c599f9b-bc42-4d71-8ba4-1da47c4ebe9f admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/6a9c1141-39ad-4b94-b761-fb68d583b749 HTTP/1.1" status: 204 len: 168 time: 0.1360500 Dec 20 05:54:46.984301 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c599f9b-bc42-4d71-8ba4-1da47c4ebe9f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a9c1141-39ad-4b94-b761-fb68d583b749,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:47.066241 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 43930) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:47.082235 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cb32f75d-7e19-408f-a691-e80f757fe82d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:47.174246 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cb32f75d-7e19-408f-a691-e80f757fe82d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:47.179381 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cb32f75d-7e19-408f-a691-e80f757fe82d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:47.218256 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-cb32f75d-7e19-408f-a691-e80f757fe82d admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=1ec33b41bcd04b67ae9e716f153b9785&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1505413 Dec 20 05:54:47.218978 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb32f75d-7e19-408f-a691-e80f757fe82d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2505abe9-a5fc-4b62-91f4-f5f821b3ba4a,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:47.221150 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 43940) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:47.277942 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4ba28042-2f71-4533-a942-6e6204dcddfb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:47.304870 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4ba28042-2f71-4533-a942-6e6204dcddfb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:47.362340 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4ba28042-2f71-4533-a942-6e6204dcddfb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:47.366499 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4ba28042-2f71-4533-a942-6e6204dcddfb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:47.370501 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-4ba28042-2f71-4533-a942-6e6204dcddfb admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/2505abe9-a5fc-4b62-91f4-f5f821b3ba4a HTTP/1.1" status: 204 len: 168 time: 0.1480527 Dec 20 05:54:47.382059 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ba28042-2f71-4533-a942-6e6204dcddfb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2505abe9-a5fc-4b62-91f4-f5f821b3ba4a,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:47.759353 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 43968) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:47.773169 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9e9eaff7-5d66-4f8b-adb1-f2adfe405149 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:47.858570 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9e9eaff7-5d66-4f8b-adb1-f2adfe405149 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:47.862935 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9e9eaff7-5d66-4f8b-adb1-f2adfe405149 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:47.895050 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-9e9eaff7-5d66-4f8b-adb1-f2adfe405149 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=a63acac854894642a612c252573e6517&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1342995 Dec 20 05:54:47.897498 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 44000) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:47.911939 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e9eaff7-5d66-4f8b-adb1-f2adfe405149 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=876cd4c5-f913-4815-9ad0-1f38500f41f8,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:48.144109 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a0fadc4f-0445-41e6-98a1-56af6824ba56 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:48.177006 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a0fadc4f-0445-41e6-98a1-56af6824ba56 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:48.240816 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a0fadc4f-0445-41e6-98a1-56af6824ba56 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:48.243837 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a0fadc4f-0445-41e6-98a1-56af6824ba56 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:48.245005 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-a0fadc4f-0445-41e6-98a1-56af6824ba56 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/876cd4c5-f913-4815-9ad0-1f38500f41f8 HTTP/1.1" status: 204 len: 168 time: 0.3459048 Dec 20 05:54:48.254963 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0fadc4f-0445-41e6-98a1-56af6824ba56 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=876cd4c5-f913-4815-9ad0-1f38500f41f8,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:49.414391 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 44108) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:49.469282 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_v2 [None req-6901d1f6-d359-4224-9446-d33777ad2094 admin admin] Deleting subnet 385e0f7c-479c-4f5c-84eb-a5a7aeba6f4c {{(pid=102446) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 05:54:49.473134 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6901d1f6-d359-4224-9446-d33777ad2094 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:49.522946 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6901d1f6-d359-4224-9446-d33777ad2094 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8976279'] for subnet, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:49.572026 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6901d1f6-d359-4224-9446-d33777ad2094 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:49.634920 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6901d1f6-d359-4224-9446-d33777ad2094 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9173344', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3270978'] for subnet, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:49.666522 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6901d1f6-d359-4224-9446-d33777ad2094 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:49.670926 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-6901d1f6-d359-4224-9446-d33777ad2094 admin admin] 10.222.0.46 "DELETE /v2.0/subnets/385e0f7c-479c-4f5c-84eb-a5a7aeba6f4c HTTP/1.1" status: 204 len: 168 time: 0.2552826 Dec 20 05:54:49.671965 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6901d1f6-d359-4224-9446-d33777ad2094 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=385e0f7c-479c-4f5c-84eb-a5a7aeba6f4c,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:49.673487 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 44122) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:49.752833 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-22f4e883-bdbf-4350-b710-339a457cf7e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:49.833653 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-22f4e883-bdbf-4350-b710-339a457cf7e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:49.853472 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-22f4e883-bdbf-4350-b710-339a457cf7e7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['43c0c2bb-3a2a-478c-b157-c23e2b672361']}} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:49.864299 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-22f4e883-bdbf-4350-b710-339a457cf7e7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bb43682f-2240-467e-b9ff-f7edf582b7d1') {'for_net_delete': True} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:49.864591 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-22f4e883-bdbf-4350-b710-339a457cf7e7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bb43682f-2240-467e-b9ff-f7edf582b7d1') {} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:49.874475 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-22f4e883-bdbf-4350-b710-339a457cf7e7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3457718'] for segment, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:49.886987 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-22f4e883-bdbf-4350-b710-339a457cf7e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:49.893639 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-22f4e883-bdbf-4350-b710-339a457cf7e7 admin admin] Releasing vlan 426 on physical network physnet1 to pool {{(pid=102445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 05:54:49.894074 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-22f4e883-bdbf-4350-b710-339a457cf7e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3465205'] for segment, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: Traceback (most recent call last): Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: timer() Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: cb(*args, **kw) Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: return func(*args, **kwargs) Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: self._notify() Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: self.callback(batched_events) Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: event.method(event) Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: return f(self, *a, **k) Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._get(url).json() Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: return self.request(url, 'GET', **kwargs) Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 05:54:49.895923 dv-cinder-822278-1-iscsi neutron-server[102445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 05:54:49.954992 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-22f4e883-bdbf-4350-b710-339a457cf7e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:49.962326 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-22f4e883-bdbf-4350-b710-339a457cf7e7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:49.968738 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-22f4e883-bdbf-4350-b710-339a457cf7e7 admin admin] 10.222.0.46 "DELETE /v2.0/networks/43c0c2bb-3a2a-478c-b157-c23e2b672361 HTTP/1.1" status: 204 len: 168 time: 0.2905717 Dec 20 05:54:49.976401 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22f4e883-bdbf-4350-b710-339a457cf7e7 admin admin] Pushing event deleted for resources: {'Network': ['ID=43c0c2bb-3a2a-478c-b157-c23e2b672361,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:50.128319 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 44130) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:50.166110 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-a11738b6-eff5-4a12-8a86-c51a5e803afd admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=2ffd6c4703134e94b747f03bda57e076&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0367048 Dec 20 05:54:50.168572 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 44132) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:50.214522 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b9c1556e-bc98-4457-9390-383b31659feb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:50.235639 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b9c1556e-bc98-4457-9390-383b31659feb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:50.280824 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b9c1556e-bc98-4457-9390-383b31659feb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:50.283473 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b9c1556e-bc98-4457-9390-383b31659feb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:50.284650 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-b9c1556e-bc98-4457-9390-383b31659feb admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/2c6b7a99-e092-41e3-8114-c4404723cbd0 HTTP/1.1" status: 204 len: 168 time: 0.1152191 Dec 20 05:54:50.292152 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9c1556e-bc98-4457-9390-383b31659feb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c6b7a99-e092-41e3-8114-c4404723cbd0,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:50.699603 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-22d4760c-a4c3-4b92-a616-750068fa8531 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/networks?tenant_id=07a060e12902490eadd093437976e4d4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0372012 Dec 20 05:54:50.941456 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-828bdf9a-2662-41bf-b94a-e61147388eb0 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:50.943500 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-828bdf9a-2662-41bf-b94a-e61147388eb0 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2381389 Dec 20 05:54:50.977866 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-1fd0ff97-27ea-42de-b0cb-636ccd39ba23 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/quotas/07a060e12902490eadd093437976e4d4 HTTP/1.1" status: 200 len: 375 time: 0.0183616 Dec 20 05:54:51.021005 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-823db272-85c5-43b3-bbda-20bae0a2a81e tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=07a060e12902490eadd093437976e4d4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0420918 Dec 20 05:54:51.090185 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 44200) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:51.250156 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 44212) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:51.266276 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-57f0fd46-0815-4eb2-a4bf-edf58b267888 req-3178312b-ef14-4d70-ab16-788686d2cbaa tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 210 time: 0.0459061 Dec 20 05:54:51.350445 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ecd9dc9d-0ac8-4c70-a3e3-15f820e555b6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.397591 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1549376031-network', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:54:51.428680 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] Made reservation on behalf of a2e9de0d64e642f08bf90d402e77baa3 for: {'network': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:54:51.431964 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.446647 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.495445 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ecd9dc9d-0ac8-4c70-a3e3-15f820e555b6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.499647 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ecd9dc9d-0ac8-4c70-a3e3-15f820e555b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.541094 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-ecd9dc9d-0ac8-4c70-a3e3-15f820e555b6 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=12d0a4654b42412aa9160681c93ddbca&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4496295 Dec 20 05:54:51.542339 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecd9dc9d-0ac8-4c70-a3e3-15f820e555b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9b0fbd4b-e173-4243-9e7b-f62610b775be,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:51.545990 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 44230) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:51.569518 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.574287 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.607746 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] vlan segment allocate from pool success with {'vlan_id': 446, 'physical_network': 'physnet1'} {{(pid=102446) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:54:51.611480 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-78ddf2b0-47a1-422b-9ece-eb9d7c374e63 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.618462 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:51.625542 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.626323 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.segments_db [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] Added segment e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e of type vlan for network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a Dec 20 05:54:51.638221 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-78ddf2b0-47a1-422b-9ece-eb9d7c374e63 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.689455 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.714947 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-78ddf2b0-47a1-422b-9ece-eb9d7c374e63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.720162 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-78ddf2b0-47a1-422b-9ece-eb9d7c374e63 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.721436 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-78ddf2b0-47a1-422b-9ece-eb9d7c374e63 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/9b0fbd4b-e173-4243-9e7b-f62610b775be HTTP/1.1" status: 204 len: 168 time: 0.1742880 Dec 20 05:54:51.739654 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.741188 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78ddf2b0-47a1-422b-9ece-eb9d7c374e63 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b0fbd4b-e173-4243-9e7b-f62610b775be,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:51.742015 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:51.743781 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:51.831007 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 0.5795267 Dec 20 05:54:51.833921 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 44246) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:51.838954 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-fd0ac568-b20f-4b7b-a98c-f000b1ff3d2c admin admin] Request body: {'subnet': {'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1549376031-subnet', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:54:51.843131 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f4c3262-5b1a-459b-8cfa-fa8ee0ee715e admin admin] Pushing event updated for resources: {'Network': ['ID=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:51.854453 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:54:51.870290 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd0ac568-b20f-4b7b-a98c-f000b1ff3d2c admin admin] Made reservation on behalf of a2e9de0d64e642f08bf90d402e77baa3 for: {'subnet': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:54:51.873163 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fd0ac568-b20f-4b7b-a98c-f000b1ff3d2c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3270951'] for subnet, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:52.085852 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fd0ac568-b20f-4b7b-a98c-f000b1ff3d2c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9168037', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3270985'] for subnet, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:52.147113 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd0ac568-b20f-4b7b-a98c-f000b1ff3d2c admin admin] Pushing event updated for resources: {'Subnet': ['ID=e1658c3d-4c2e-4687-a529-637456d3a81c,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:52.152250 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd0ac568-b20f-4b7b-a98c-f000b1ff3d2c admin admin] Checking segment: {'id': 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:54:52.152544 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd0ac568-b20f-4b7b-a98c-f000b1ff3d2c admin admin] Network hostable DHCP agents. Network: d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102446) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:54:52.170263 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd0ac568-b20f-4b7b-a98c-f000b1ff3d2c admin admin] Network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102446) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:54:52.179722 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-fd0ac568-b20f-4b7b-a98c-f000b1ff3d2c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a) {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:54:52.184017 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd0ac568-b20f-4b7b-a98c-f000b1ff3d2c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:52.185502 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fd0ac568-b20f-4b7b-a98c-f000b1ff3d2c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:52.189087 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ae0ce39-56fe-4202-b663-717ea468ac8a None None] Network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:54:52.204937 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-fd0ac568-b20f-4b7b-a98c-f000b1ff3d2c admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 0.3669405 Dec 20 05:54:52.205279 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 44250) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:52.210222 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1549376031-router', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:54:52.234666 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1698740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25959'] for router, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:52.235785 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1698340', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1703163', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1634740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25982'] for router, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:52.290140 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:52.299560 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-003aa5ca-fabf-4d8f-9433-e69ad8cc6076 None None] Network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:54:52.424498 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d68d55e7-d6a5-449e-a62e-523e022cf786 req-02ea8821-22e9-4a71-840e-bb6657be8f0f tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 210 time: 0.0602393 Dec 20 05:54:52.462342 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:52.697153 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-db21ac1d-ca01-45a8-b3a2-4c284cf25851 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.54 "GET /v2.0/networks?tenant_id=07a060e12902490eadd093437976e4d4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0481818 Dec 20 05:54:52.723108 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:52.766038 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:52.921921 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-073965e1-02e1-42d9-a331-6767f5f00ef1 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:52.923757 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-073965e1-02e1-42d9-a331-6767f5f00ef1 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2137055 Dec 20 05:54:52.947135 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Allocated IP 172.27.3.211 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/45f06a12-9255-46cd-92b8-3cb459fa9843) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:54:52.952572 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Request body: {'port': {'device_id': '8ed0331a-2675-4de2-8b1f-02361c9c12f7', 'network_id': 'c26632c1-19ed-44a7-b956-a61862e2b6b0', 'admin_state_up': True, 'tenant_id': '07a060e12902490eadd093437976e4d4'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:54:53.138551 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:53.150608 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Made reservation on behalf of 07a060e12902490eadd093437976e4d4 for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:54:53.155079 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:53.171102 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:53.212013 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:53.281203 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 44276) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:53.285167 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Pushing event updated for resources: {'Port': ['ID=45f06a12-9255-46cd-92b8-3cb459fa9843,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:53.300467 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:54:53.306336 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:54:53.309620 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:54:53.379277 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:53.415698 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:53.426885 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aa59b073-ade2-4e81-a045-fed174a65017 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:53.525201 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aa59b073-ade2-4e81-a045-fed174a65017 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:53.529752 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aa59b073-ade2-4e81-a045-fed174a65017 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:53.568785 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-aa59b073-ade2-4e81-a045-fed174a65017 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=e6f3a1c86f244217aadbaaa3d7ee50d2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2863607 Dec 20 05:54:53.569697 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa59b073-ade2-4e81-a045-fed174a65017 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ba15dd9-812d-4f9c-8a9e-e7d467b33fb4,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:53.572037 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 44290) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:53.624706 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5e0deb73-424e-43df-bbf6-c959ce11f681 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:53.646674 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5e0deb73-424e-43df-bbf6-c959ce11f681 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:53.701973 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5e0deb73-424e-43df-bbf6-c959ce11f681 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:53.704016 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5e0deb73-424e-43df-bbf6-c959ce11f681 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:53.710881 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-5e0deb73-424e-43df-bbf6-c959ce11f681 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/5ba15dd9-812d-4f9c-8a9e-e7d467b33fb4 HTTP/1.1" status: 204 len: 168 time: 0.1375911 Dec 20 05:54:53.720521 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e0deb73-424e-43df-bbf6-c959ce11f681 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ba15dd9-812d-4f9c-8a9e-e7d467b33fb4,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:53.768880 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2dac65c8-9e12-4a86-946a-b793cda95901 req-b994fbf6-6593-462d-9180-f7720d6adee6 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 210 time: 0.1233802 Dec 20 05:54:53.802695 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d98b6c59-460b-46cb-86b0-929b673ba2ca,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:53.912681 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Allocated IP 192.168.233.60 (c26632c1-19ed-44a7-b956-a61862e2b6b0/af5b09fe-0910-495b-aaf9-ec3ee59fc9a5/34047432-9d11-4c88-b220-6401301b0066) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:54:53.988552 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.040362 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 44298) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:54.068758 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7a626d51-2678-47ca-af2a-cd4af56e0a5f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.159745 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7a626d51-2678-47ca-af2a-cd4af56e0a5f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.165184 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7a626d51-2678-47ca-af2a-cd4af56e0a5f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.203275 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a626d51-2678-47ca-af2a-cd4af56e0a5f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e5f340c0-78d5-4545-90ae-6d654be63aca,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:54.208634 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.232473 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-7a626d51-2678-47ca-af2a-cd4af56e0a5f admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=b5bbcfef52e74466899f49c2ed921f44&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1910319 Dec 20 05:54:54.235972 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 44302) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:54.299285 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-58f7637f-891d-4f2e-84f4-a22380e07f18 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.320871 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-58f7637f-891d-4f2e-84f4-a22380e07f18 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.335241 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.344011 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1698355', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1703078'] for router, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.374444 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-58f7637f-891d-4f2e-84f4-a22380e07f18 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.377308 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-58f7637f-891d-4f2e-84f4-a22380e07f18 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.378658 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-58f7637f-891d-4f2e-84f4-a22380e07f18 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/e5f340c0-78d5-4545-90ae-6d654be63aca HTTP/1.1" status: 204 len: 168 time: 0.1417489 Dec 20 05:54:54.399269 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58f7637f-891d-4f2e-84f4-a22380e07f18 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5f340c0-78d5-4545-90ae-6d654be63aca,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:54.429662 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Network c26632c1-19ed-44a7-b956-a61862e2b6b0 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:54:54.442371 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:54:54.446044 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:54:54.448631 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Pushing event updated for resources: {'Port': ['ID=34047432-9d11-4c88-b220-6401301b0066,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:54.539026 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:54.539722 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.565739 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-d0c8eed9-53fb-4448-877b-e9091d7d3a84 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.6199269 Dec 20 05:54:54.593169 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Request body: {'port': {'device_id': '8ed0331a-2675-4de2-8b1f-02361c9c12f7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:54:54.646720 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Router 78306cdd-08fd-430b-bc23-bf16053632cc is scheduled to L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d with binding_index 1 {{(pid=102445) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 20 05:54:54.722239 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.767614 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-f8f47d0e-4577-40a8-a6e6-2ba065a1bf1d None None] Provisioning complete for port 34047432-9d11-4c88-b220-6401301b0066 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:54:54.768867 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f8f47d0e-4577-40a8-a6e6-2ba065a1bf1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.814500 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-f8f47d0e-4577-40a8-a6e6-2ba065a1bf1d None None] Port 34047432-9d11-4c88-b220-6401301b0066 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:54:54.837726 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:54:54.850242 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Sync routers for ids ['78306cdd-08fd-430b-bc23-bf16053632cc'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:54:54.862944 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Routers {'78306cdd-08fd-430b-bc23-bf16053632cc'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:54:54.864913 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:54:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['78306cdd-08fd-430b-bc23-bf16053632cc'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:54.921489 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] Publish callbacks [] for router, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:54.926508 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-dac6592f-52f1-43f5-8255-c5e97024e45c admin admin] 10.222.0.46 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 2.7169697 Dec 20 05:54:54.926659 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 44336) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:55.028494 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2af4504d-b7d4-457b-895d-4b1c9fdf6a6a req-b080083b-0c15-4320-aa1c-fd5334b2cfee tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:55.030679 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2af4504d-b7d4-457b-895d-4b1c9fdf6a6a req-b080083b-0c15-4320-aa1c-fd5334b2cfee tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 935 time: 0.1235690 Dec 20 05:54:55.035283 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 44338) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:55.056560 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Set router 78306cdd-08fd-430b-bc23-bf16053632cc gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:54:55.135552 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2af4504d-b7d4-457b-895d-4b1c9fdf6a6a req-85caa034-6f33-4bb3-9dee-969bfd6e8bb0 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/security-groups?id=d98b6c59-460b-46cb-86b0-929b673ba2ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0982864 Dec 20 05:54:55.271614 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 34047432-9d11-4c88-b220-6401301b0066 {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:54:55.273834 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-086ae81b-0b95-4ab3-a83c-06d89a9f010c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.280422 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.295733 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Transition to ACTIVE for port object 34047432-9d11-4c88-b220-6401301b0066 will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 05:54:55.302201 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.322071 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'name': 'tempest-ServerRescueNegativeTestJSON-1549376031-router', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.211'}], 'enable_snat': True}, 'gw_port_id': '45f06a12-9255-46cd-92b8-3cb459fa9843', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:54:53Z', 'revision_number': 3, 'project_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'gw_port': {'id': '45f06a12-9255-46cd-92b8-3cb459fa9843', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:72:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:54:52Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:55.362425 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Checking router: 78306cdd-08fd-430b-bc23-bf16053632cc for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:54:55.362892 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Updating router 78306cdd-08fd-430b-bc23-bf16053632cc port 45f06a12-9255-46cd-92b8-3cb459fa9843 binding host dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:54:55.384789 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Pushing event updated for resources: {'Port': ['ID=34047432-9d11-4c88-b220-6401301b0066,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:55.390498 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.566189 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Attempting to bind port 34047432-9d11-4c88-b220-6401301b0066 on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:54:55.566966 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Attempting to bind port 34047432-9d11-4c88-b220-6401301b0066 by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': 'e75dfcc1-ca2a-46c6-a0aa-251ee070119b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'c26632c1-19ed-44a7-b956-a61862e2b6b0'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:54:55.567548 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Attempting to bind port 34047432-9d11-4c88-b220-6401301b0066 on network c26632c1-19ed-44a7-b956-a61862e2b6b0 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:54:55.575033 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Port 34047432-9d11-4c88-b220-6401301b0066 on network c26632c1-19ed-44a7-b956-a61862e2b6b0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 05:54:55.575893 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Attempting to bind port 34047432-9d11-4c88-b220-6401301b0066 on network c26632c1-19ed-44a7-b956-a61862e2b6b0 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:54:55.584590 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 54, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:54:55.584932 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Checking segment: {'id': 'e75dfcc1-ca2a-46c6-a0aa-251ee070119b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'c26632c1-19ed-44a7-b956-a61862e2b6b0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:54:55.585844 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Bound using segment: {'id': 'e75dfcc1-ca2a-46c6-a0aa-251ee070119b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'c26632c1-19ed-44a7-b956-a61862e2b6b0'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:54:55.586985 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Bound port: 34047432-9d11-4c88-b220-6401301b0066, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e75dfcc1-ca2a-46c6-a0aa-251ee070119b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'c26632c1-19ed-44a7-b956-a61862e2b6b0'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:54:55.587352 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.615966 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-086ae81b-0b95-4ab3-a83c-06d89a9f010c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.625411 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-086ae81b-0b95-4ab3-a83c-06d89a9f010c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.659181 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-086ae81b-0b95-4ab3-a83c-06d89a9f010c admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=3056bcfde6114195a81fc311c5b3052e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6210916 Dec 20 05:54:55.662160 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 44354) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:54:55.682232 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.696411 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-086ae81b-0b95-4ab3-a83c-06d89a9f010c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37feb7fb-e085-4e28-9a08-7d83fa1c9aa7,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:55.733400 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] For port 34047432-9d11-4c88-b220-6401301b0066, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:54:55.737829 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] For port 34047432-9d11-4c88-b220-6401301b0066, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=34047432-9d11-4c88-b220-6401301b0066,segment=NetworkSegment(e75dfcc1-ca2a-46c6-a0aa-251ee070119b),segment_id=e75dfcc1-ca2a-46c6-a0aa-251ee070119b)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:54:55.748824 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.763773 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-5a23dd23-acd1-4c15-b24e-6ed1af07d780 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.808682 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:55.809388 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.810832 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] 10.222.0.54 "PUT /v2.0/ports/34047432-9d11-4c88-b220-6401301b0066 HTTP/1.1" status: 200 len: 1097 time: 1.2230535 Dec 20 05:54:55.813456 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Publish callbacks [] for port, precommit_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.814144 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8ed0331a-2675-4de2-8b1f-02361c9c12f7', 'tag': '34047432-9d11-4c88-b220-6401301b0066'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:54:55.816492 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-28ab8c68-b03f-4af8-9cc7-71a06504eb9e" -d '{"events": [{"name": "network-changed", "server_uuid": "8ed0331a-2675-4de2-8b1f-02361c9c12f7", "tag": "34047432-9d11-4c88-b220-6401301b0066"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:54:55.822259 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.851220 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-5a23dd23-acd1-4c15-b24e-6ed1af07d780 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.886250 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Pushing event updated for resources: {'Port': ['ID=45f06a12-9255-46cd-92b8-3cb459fa9843,revision_number=2']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:55.891459 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ef9044d-3759-48cb-ab53-d8adb8041c0c service neutron] Pushing event updated for resources: {'Port': ['ID=34047432-9d11-4c88-b220-6401301b0066,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:55.899312 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:55.899842 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:55.900310 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:55.900764 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:55.901283 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:55.901793 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:55.901904 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:54:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-63421d57-ad48-437a-b75e-a9e7a484f741 x-openstack-request-id: req-63421d57-ad48-437a-b75e-a9e7a484f741 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:54:55.902098 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8ed0331a-2675-4de2-8b1f-02361c9c12f7", "tag": "34047432-9d11-4c88-b220-6401301b0066", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:54:55.902346 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-63421d57-ad48-437a-b75e-a9e7a484f741 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:54:55.902451 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:55.902754 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8ed0331a-2675-4de2-8b1f-02361c9c12f7', 'tag': '34047432-9d11-4c88-b220-6401301b0066', 'status': 'completed', 'code': 200} Dec 20 05:54:55.902981 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:55.903437 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:55.903919 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:55.904347 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:55.904773 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:55.905211 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:55.927047 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Attempting to bind port 45f06a12-9255-46cd-92b8-3cb459fa9843 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:54:55.927693 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Attempting to bind port 45f06a12-9255-46cd-92b8-3cb459fa9843 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:54:55.928165 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Attempting to bind port 45f06a12-9255-46cd-92b8-3cb459fa9843 on network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:54:55.935563 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 54, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:54:55.936071 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Checking segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102448) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:54:55.936602 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:55.937392 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Bound using segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:54:55.938086 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Bound port: 45f06a12-9255-46cd-92b8-3cb459fa9843, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:54:55.938594 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:56.021816 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Allocated IP 172.20.0.1 (d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a/e1658c3d-4c2e-4687-a529-637456d3a81c/e33a1ab9-8ab9-480c-bbce-99e76e107aac) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:54:56.024227 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-5a23dd23-acd1-4c15-b24e-6ed1af07d780 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:56.027551 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-5a23dd23-acd1-4c15-b24e-6ed1af07d780 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:56.031632 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-5a23dd23-acd1-4c15-b24e-6ed1af07d780 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/37feb7fb-e085-4e28-9a08-7d83fa1c9aa7 HTTP/1.1" status: 204 len: 168 time: 0.3682666 Dec 20 05:54:56.039231 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] For port 45f06a12-9255-46cd-92b8-3cb459fa9843, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102448) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:54:56.043170 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] For port 45f06a12-9255-46cd-92b8-3cb459fa9843, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=45f06a12-9255-46cd-92b8-3cb459fa9843,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102448) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:54:56.045478 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a23dd23-acd1-4c15-b24e-6ed1af07d780 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37feb7fb-e085-4e28-9a08-7d83fa1c9aa7,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:56.049883 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:56.051501 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-c12e62e1-8c2c-4842-9c9c-28dfe213c182 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:56.060620 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-c12e62e1-8c2c-4842-9c9c-28dfe213c182 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=07a060e12902490eadd093437976e4d4&device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 1100 time: 0.1101854 Dec 20 05:54:56.121422 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-942b5ba8-d7cb-4e18-a55c-49df789cda7d None None] Pushing event updated for resources: {'Port': ['ID=45f06a12-9255-46cd-92b8-3cb459fa9843,revision_number=3']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:56.147050 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Routers {'78306cdd-08fd-430b-bc23-bf16053632cc'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:54:56.147887 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:54:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['78306cdd-08fd-430b-bc23-bf16053632cc'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:56.162011 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-bb208b28-9111-4b9a-8fd1-9b20ae9e20af service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.60&port_id=34047432-9d11-4c88-b220-6401301b0066 HTTP/1.1" status: 200 len: 217 time: 0.0914652 Dec 20 05:54:56.264741 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] Set router 78306cdd-08fd-430b-bc23-bf16053632cc gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:54:56.311623 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:56.335795 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0037f596-7f77-49ae-8f31-099ecf580acd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:56.338079 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-0037f596-7f77-49ae-8f31-099ecf580acd service neutron] 10.222.0.54 "GET /v2.0/subnets?id=af5b09fe-0910-495b-aaf9-ec3ee59fc9a5 HTTP/1.1" status: 200 len: 843 time: 0.1664402 Dec 20 05:54:56.365839 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:56.389048 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ad3182-9bff-4102-a224-9a69c2c838d4 req-b9e12f42-a442-4a11-9d7c-97c30254f737 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:56.390787 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1ad3182-9bff-4102-a224-9a69c2c838d4 req-b9e12f42-a442-4a11-9d7c-97c30254f737 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 947 time: 0.1167684 Dec 20 05:54:56.410856 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-8288392f-52b3-4199-b6bf-8b943b0e99de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:56.412579 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-8288392f-52b3-4199-b6bf-8b943b0e99de service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=c26632c1-19ed-44a7-b956-a61862e2b6b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0669250 Dec 20 05:54:56.542118 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:54:56.547219 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:54:56.564264 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Pushing event updated for resources: {'Port': ['ID=e33a1ab9-8ab9-480c-bbce-99e76e107aac,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:56.572718 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:54:56.633421 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1ad3182-9bff-4102-a224-9a69c2c838d4 req-aa73267b-1420-4b38-86d2-6871658e45d7 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/security-groups?id=d98b6c59-460b-46cb-86b0-929b673ba2ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2310770 Dec 20 05:54:56.674046 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-43f4123f-85f7-4378-94ee-c83adaffc149 service neutron] 10.222.0.54 "GET /v2.0/networks/c26632c1-19ed-44a7-b956-a61862e2b6b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2509961 Dec 20 05:54:56.682455 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1703675'] for router_interface, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:56.752405 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'name': 'tempest-ServerRescueNegativeTestJSON-1549376031-router', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.211'}], 'enable_snat': True}, 'gw_port_id': '45f06a12-9255-46cd-92b8-3cb459fa9843', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:54:53Z', 'revision_number': 3, 'project_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'gw_port': {'id': '45f06a12-9255-46cd-92b8-3cb459fa9843', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:72:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:54:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:56.796921 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a782ccb6-740d-48ee-8c1f-5696cb904dc7 None None] The sync data for ids ['78306cdd-08fd-430b-bc23-bf16053632cc'] in dv-cinder-822278-1-iscsi is: [{'id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'name': 'tempest-ServerRescueNegativeTestJSON-1549376031-router', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.211'}], 'enable_snat': True}, 'gw_port_id': '45f06a12-9255-46cd-92b8-3cb459fa9843', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:54:53Z', 'revision_number': 3, 'project_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'gw_port': {'id': '45f06a12-9255-46cd-92b8-3cb459fa9843', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:72:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:54:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:54:56.874525 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:57.118821 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc0e699a-a16a-4af9-87d3-83eafa0ce4c7 req-3f9ae2eb-a68b-48c1-8652-73fc2b2390a7 service neutron] 10.222.0.54 "GET /v2.0/networks/c26632c1-19ed-44a7-b956-a61862e2b6b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4293766 Dec 20 05:54:57.135552 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:57.141389 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:57.247960 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Pushing event updated for resources: {'Port': ['ID=e33a1ab9-8ab9-480c-bbce-99e76e107aac,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:57.256070 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1617520', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1697131'] for router_interface, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:57.324303 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28ab8c68-b03f-4af8-9cc7-71a06504eb9e req-daa82c97-16b6-4258-aef4-cfbcf911a3a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:57.326628 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-28ab8c68-b03f-4af8-9cc7-71a06504eb9e req-daa82c97-16b6-4258-aef4-cfbcf911a3a8 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=07a060e12902490eadd093437976e4d4&device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 1100 time: 0.0663438 Dec 20 05:54:57.399602 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:54:57.401978 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:54:57.473418 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28ab8c68-b03f-4af8-9cc7-71a06504eb9e req-22dd0602-aabe-450d-ba9d-07763f249eb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:57.475005 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-28ab8c68-b03f-4af8-9cc7-71a06504eb9e req-22dd0602-aabe-450d-ba9d-07763f249eb6 service neutron] 10.222.0.54 "GET /v2.0/networks?id=c26632c1-19ed-44a7-b956-a61862e2b6b0 HTTP/1.1" status: 200 len: 870 time: 0.1405613 Dec 20 05:54:57.533744 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-28ab8c68-b03f-4af8-9cc7-71a06504eb9e req-b495301b-f1aa-4c9f-9325-add83e364131 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.60&port_id=34047432-9d11-4c88-b220-6401301b0066 HTTP/1.1" status: 200 len: 217 time: 0.0499125 Dec 20 05:54:57.547709 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Router 78306cdd-08fd-430b-bc23-bf16053632cc has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:54:57.646874 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28ab8c68-b03f-4af8-9cc7-71a06504eb9e req-2e092f26-04f8-460f-9a33-f99d2fba0441 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:57.648353 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-28ab8c68-b03f-4af8-9cc7-71a06504eb9e req-2e092f26-04f8-460f-9a33-f99d2fba0441 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=af5b09fe-0910-495b-aaf9-ec3ee59fc9a5 HTTP/1.1" status: 200 len: 843 time: 0.1042778 Dec 20 05:54:57.755004 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28ab8c68-b03f-4af8-9cc7-71a06504eb9e req-e832cc1d-1b5e-4c73-9826-d773cc497766 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:57.757135 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-28ab8c68-b03f-4af8-9cc7-71a06504eb9e req-e832cc1d-1b5e-4c73-9826-d773cc497766 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=c26632c1-19ed-44a7-b956-a61862e2b6b0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0982251 Dec 20 05:54:57.911441 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 45f06a12-9255-46cd-92b8-3cb459fa9843 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:54:57.986696 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8575a487-cd7b-41ae-98d2-40898c28e5ec req-0945a6ca-fdf3-4ece-a06f-35106cfa4e06 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:58.001208 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8575a487-cd7b-41ae-98d2-40898c28e5ec req-0945a6ca-fdf3-4ece-a06f-35106cfa4e06 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 947 time: 0.1886060 Dec 20 05:54:58.020664 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 45f06a12-9255-46cd-92b8-3cb459fa9843 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:54:58.021344 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:58.107958 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:54:58.128013 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8575a487-cd7b-41ae-98d2-40898c28e5ec req-3a56f368-2646-427c-834b-f30932deeb7a tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/security-groups?id=d98b6c59-460b-46cb-86b0-929b673ba2ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1194859 Dec 20 05:54:58.128013 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-28ab8c68-b03f-4af8-9cc7-71a06504eb9e req-31033297-20d9-41b7-8980-1eae5f6edefd service neutron] 10.222.0.54 "GET /v2.0/networks/c26632c1-19ed-44a7-b956-a61862e2b6b0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3548384 Dec 20 05:54:58.129670 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-92abcd99-74c9-47b8-a01d-8a5ae68aa6d1 admin admin] 10.222.0.46 "PUT /v2.0/routers/78306cdd-08fd-430b-bc23-bf16053632cc/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2024167 Dec 20 05:54:58.175036 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:58.206595 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port 45f06a12-9255-46cd-92b8-3cb459fa9843, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=45f06a12-9255-46cd-92b8-3cb459fa9843,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:54:58.216943 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:58.339257 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-28ab8c68-b03f-4af8-9cc7-71a06504eb9e req-317e4830-8c89-4f2f-8404-269a7f2243c6 service neutron] 10.222.0.54 "GET /v2.0/networks/c26632c1-19ed-44a7-b956-a61862e2b6b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2021368 Dec 20 05:54:58.399263 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=45f06a12-9255-46cd-92b8-3cb459fa9843,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:54:58.415822 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:58.416498 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:58.417003 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:58.417623 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:58.418111 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:58.425768 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:58.426148 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:58.426491 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:58.426828 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:58.427181 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:58.427535 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:58.427860 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:58.428190 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:54:58.820090 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-d5ee152d-01d0-4178-bb42-f8f29022f29c tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:58.821655 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-d5ee152d-01d0-4178-bb42-f8f29022f29c tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/networks?id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a HTTP/1.1" status: 200 len: 819 time: 0.1380048 Dec 20 05:54:58.837725 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-2d27bc8c-b676-4da5-a44c-c781ed73a0a9 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/quotas/a2e9de0d64e642f08bf90d402e77baa3 HTTP/1.1" status: 200 len: 375 time: 0.0097861 Dec 20 05:54:58.893772 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-f0f99018-48ad-4d95-bd14-7d423992e9a9 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=a2e9de0d64e642f08bf90d402e77baa3&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0499609 Dec 20 05:54:58.986251 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-aefb3439-292e-4aa1-9a31-06b9f37a5f9a service neutron] 10.222.0.46 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851204 Dec 20 05:54:59.079087 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-d2ee5ae2-9f35-48c9-923f-52d0f19165e6 service neutron] 10.222.0.46 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862665 Dec 20 05:54:59.115333 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Sync routers for ids ['78306cdd-08fd-430b-bc23-bf16053632cc'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:54:59.126665 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Routers {'78306cdd-08fd-430b-bc23-bf16053632cc'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:54:59.127561 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:54:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['78306cdd-08fd-430b-bc23-bf16053632cc'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:59.272788 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Set router 78306cdd-08fd-430b-bc23-bf16053632cc gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:54:59.280046 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-118dd05a-fda9-4d26-ae64-a6f7792c8ac1 req-80ebcee0-cc4e-4394-96b8-a79e8d0b989b tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:54:59.288209 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-118dd05a-fda9-4d26-ae64-a6f7792c8ac1 req-80ebcee0-cc4e-4394-96b8-a79e8d0b989b tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 947 time: 0.0698044 Dec 20 05:54:59.336524 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-98ef6a09-51a3-4521-b9af-ced69160f4c2 req-34e52b6a-fca7-496d-8893-eda36d6b13c9 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 210 time: 0.0456817 Dec 20 05:54:59.365978 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-118dd05a-fda9-4d26-ae64-a6f7792c8ac1 req-b36e4ac2-7dae-42e0-8ff9-ec658b16bd67 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/security-groups?id=d98b6c59-460b-46cb-86b0-929b673ba2ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0767334 Dec 20 05:54:59.516518 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'name': 'tempest-ServerRescueNegativeTestJSON-1549376031-router', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.211'}], 'enable_snat': True}, 'gw_port_id': '45f06a12-9255-46cd-92b8-3cb459fa9843', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:54:56Z', 'revision_number': 4, 'project_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'gw_port': {'id': '45f06a12-9255-46cd-92b8-3cb459fa9843', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:72:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:54:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'e33a1ab9-8ab9-480c-bbce-99e76e107aac', 'name': '', 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'mac_address': 'fa:16:3e:ed:7e:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 378, 'fixed_ips': [{'subnet_id': 'e1658c3d-4c2e-4687-a529-637456d3a81c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:54:55Z', 'updated_at': '2021-12-20T05:54:56Z', 'revision_number': 2, 'project_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'subnets': [{'id': 'e1658c3d-4c2e-4687-a529-637456d3a81c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:54:59.544939 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Checking router: 78306cdd-08fd-430b-bc23-bf16053632cc for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:54:59.545289 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Updating router 78306cdd-08fd-430b-bc23-bf16053632cc port e33a1ab9-8ab9-480c-bbce-99e76e107aac binding host dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:54:59.571861 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:59.831165 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 45f06a12-9255-46cd-92b8-3cb459fa9843 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:54:59.912704 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Publish callbacks [] for port, precommit_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:59.922180 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:54:59.973142 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 45f06a12-9255-46cd-92b8-3cb459fa9843 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:54:59.973509 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:00.008059 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fa7db76-f233-4d3e-b62b-dd400c968d58 None None] Pushing event updated for resources: {'Port': ['ID=e33a1ab9-8ab9-480c-bbce-99e76e107aac,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:00.076006 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Attempting to bind port e33a1ab9-8ab9-480c-bbce-99e76e107aac on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:55:00.076371 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Attempting to bind port e33a1ab9-8ab9-480c-bbce-99e76e107aac by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:55:00.076727 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Attempting to bind port e33a1ab9-8ab9-480c-bbce-99e76e107aac on network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:55:00.083693 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 54, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:55:00.084180 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Checking segment: {'id': 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:55:00.084590 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:00.085007 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Bound using segment: {'id': 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:55:00.085668 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Bound port: e33a1ab9-8ab9-480c-bbce-99e76e107aac, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:55:00.085968 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:00.178850 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] For port e33a1ab9-8ab9-480c-bbce-99e76e107aac, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:55:00.182083 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] For port e33a1ab9-8ab9-480c-bbce-99e76e107aac, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=e33a1ab9-8ab9-480c-bbce-99e76e107aac,segment=NetworkSegment(e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e),segment_id=e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:55:00.186620 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:00.198239 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 44562) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:00.245410 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Routers {'78306cdd-08fd-430b-bc23-bf16053632cc'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:55:00.246044 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:54:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['78306cdd-08fd-430b-bc23-bf16053632cc'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:55:00.248423 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fa7db76-f233-4d3e-b62b-dd400c968d58 None None] Pushing event updated for resources: {'Port': ['ID=e33a1ab9-8ab9-480c-bbce-99e76e107aac,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:00.339919 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-44b59eee-94fc-4c83-b6fd-535c7b3429e4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:00.434597 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-44b59eee-94fc-4c83-b6fd-535c7b3429e4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:00.439387 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-44b59eee-94fc-4c83-b6fd-535c7b3429e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:00.510427 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-44b59eee-94fc-4c83-b6fd-535c7b3429e4 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=b8513f9a17984713a7ae5c0058eaa159&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3085115 Dec 20 05:55:00.510590 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44b59eee-94fc-4c83-b6fd-535c7b3429e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07290482-141e-4941-85c3-9163807f801b,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:00.521351 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] Set router 78306cdd-08fd-430b-bc23-bf16053632cc gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:55:00.522179 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 44572) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:00.536871 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99c1e6cf-d1cd-47ad-9d95-3de3341945a0 req-f801b4f1-8e68-46d3-9927-fd450cda3d22 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:00.538362 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-99c1e6cf-d1cd-47ad-9d95-3de3341945a0 req-f801b4f1-8e68-46d3-9927-fd450cda3d22 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 947 time: 0.0816739 Dec 20 05:55:00.586573 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6bd06b4c-0e58-49dc-b205-5fe09ab655af admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:00.604363 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-99c1e6cf-d1cd-47ad-9d95-3de3341945a0 req-5d256f11-2760-4222-b522-836590ab0915 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/security-groups?id=d98b6c59-460b-46cb-86b0-929b673ba2ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0582721 Dec 20 05:55:00.622368 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6bd06b4c-0e58-49dc-b205-5fe09ab655af admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:00.677622 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6bd06b4c-0e58-49dc-b205-5fe09ab655af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:00.680420 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6bd06b4c-0e58-49dc-b205-5fe09ab655af admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:00.681565 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-6bd06b4c-0e58-49dc-b205-5fe09ab655af admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/07290482-141e-4941-85c3-9163807f801b HTTP/1.1" status: 204 len: 168 time: 0.1583555 Dec 20 05:55:00.689480 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bd06b4c-0e58-49dc-b205-5fe09ab655af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07290482-141e-4941-85c3-9163807f801b,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:00.771687 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'name': 'tempest-ServerRescueNegativeTestJSON-1549376031-router', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.211'}], 'enable_snat': True}, 'gw_port_id': '45f06a12-9255-46cd-92b8-3cb459fa9843', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:54:56Z', 'revision_number': 4, 'project_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'gw_port': {'id': '45f06a12-9255-46cd-92b8-3cb459fa9843', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:72:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:54:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'e33a1ab9-8ab9-480c-bbce-99e76e107aac', 'name': '', 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'mac_address': 'fa:16:3e:ed:7e:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 378, 'fixed_ips': [{'subnet_id': 'e1658c3d-4c2e-4687-a529-637456d3a81c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:54:55Z', 'updated_at': '2021-12-20T05:55:00Z', 'revision_number': 4, 'project_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'subnets': [{'id': 'e1658c3d-4c2e-4687-a529-637456d3a81c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:55:00.805551 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4599547c-eeda-4f35-be2c-5b182780d5a3 None None] The sync data for ids ['78306cdd-08fd-430b-bc23-bf16053632cc'] in dv-cinder-822278-1-iscsi is: [{'id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'name': 'tempest-ServerRescueNegativeTestJSON-1549376031-router', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.211'}], 'enable_snat': True}, 'gw_port_id': '45f06a12-9255-46cd-92b8-3cb459fa9843', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:54:56Z', 'revision_number': 4, 'project_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'gw_port': {'id': '45f06a12-9255-46cd-92b8-3cb459fa9843', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:72:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:54:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'e33a1ab9-8ab9-480c-bbce-99e76e107aac', 'name': '', 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'mac_address': 'fa:16:3e:ed:7e:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 378, 'fixed_ips': [{'subnet_id': 'e1658c3d-4c2e-4687-a529-637456d3a81c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:54:55Z', 'updated_at': '2021-12-20T05:55:00Z', 'revision_number': 4, 'project_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'subnets': [{'id': 'e1658c3d-4c2e-4687-a529-637456d3a81c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:55:01.522921 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 44600) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:01.639048 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1654332856-network', 'tenant_id': 'c55e4805e4ec461e98ab84a95a8755d7'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:01.665250 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] Made reservation on behalf of c55e4805e4ec461e98ab84a95a8755d7 for: {'network': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:55:01.667549 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:01.677308 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:01.709845 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-fe6898dd-d6bd-4405-bfd0-27e6f74bd112 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:01.761548 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:01.766151 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:01.789313 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] vlan segment allocate from pool success with {'vlan_id': 403, 'physical_network': 'physnet1'} {{(pid=102446) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:55:01.808034 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42fc834a-104f-4dca-a056-79de62a35aca,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:01.815486 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:01.816583 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.segments_db [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] Added segment e86c45d4-b3d7-41e1-892c-83dec0fca686 of type vlan for network ebca9b29-55b2-47f1-bcfb-6bced6fdc050 Dec 20 05:55:01.870567 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:01.880817 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device e33a1ab9-8ab9-480c-bbce-99e76e107aac up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:55:01.901580 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:01.902688 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:01.903340 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:01.951437 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4251904 Dec 20 05:55:01.954245 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 44608) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:01.955350 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port e33a1ab9-8ab9-480c-bbce-99e76e107aac triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:01.955350 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:01.959674 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-9cedb65d-ca68-4513-a7b1-8bb7b624a612 admin admin] Request body: {'subnet': {'network_id': 'ebca9b29-55b2-47f1-bcfb-6bced6fdc050', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1654332856-subnet', 'tenant_id': 'c55e4805e4ec461e98ab84a95a8755d7', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:01.997667 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9cedb65d-ca68-4513-a7b1-8bb7b624a612 admin admin] Made reservation on behalf of c55e4805e4ec461e98ab84a95a8755d7 for: {'subnet': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:55:02.000655 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9cedb65d-ca68-4513-a7b1-8bb7b624a612 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3597747'] for subnet, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:02.000981 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47af67b2-99d4-40b2-988e-c75497505e14 admin admin] Pushing event updated for resources: {'Network': ['ID=ebca9b29-55b2-47f1-bcfb-6bced6fdc050,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:02.032525 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network ebca9b29-55b2-47f1-bcfb-6bced6fdc050 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:55:02.101236 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:02.142018 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port e33a1ab9-8ab9-480c-bbce-99e76e107aac, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=e33a1ab9-8ab9-480c-bbce-99e76e107aac,segment=NetworkSegment(e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e),segment_id=e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:02.146269 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:02.190664 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9cedb65d-ca68-4513-a7b1-8bb7b624a612 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3457622', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3597789'] for subnet, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:02.201704 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=e33a1ab9-8ab9-480c-bbce-99e76e107aac,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:02.244358 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cedb65d-ca68-4513-a7b1-8bb7b624a612 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2c54f9a1-64d2-45bf-94c0-c7d4cd8d6225,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:02.255323 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cedb65d-ca68-4513-a7b1-8bb7b624a612 admin admin] Checking segment: {'id': 'e86c45d4-b3d7-41e1-892c-83dec0fca686', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': 'ebca9b29-55b2-47f1-bcfb-6bced6fdc050'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:55:02.255724 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cedb65d-ca68-4513-a7b1-8bb7b624a612 admin admin] Network hostable DHCP agents. Network: ebca9b29-55b2-47f1-bcfb-6bced6fdc050, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:55:02.273019 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cedb65d-ca68-4513-a7b1-8bb7b624a612 admin admin] Network ebca9b29-55b2-47f1-bcfb-6bced6fdc050 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:55:02.283642 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-9cedb65d-ca68-4513-a7b1-8bb7b624a612 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, ebca9b29-55b2-47f1-bcfb-6bced6fdc050) {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:55:02.288422 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9cedb65d-ca68-4513-a7b1-8bb7b624a612 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:02.289057 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9cedb65d-ca68-4513-a7b1-8bb7b624a612 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:02.294112 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7963061f-69f2-454d-ad9c-0ca8bb2209f0 None None] Network ebca9b29-55b2-47f1-bcfb-6bced6fdc050 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:55:02.309632 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-9cedb65d-ca68-4513-a7b1-8bb7b624a612 admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3534420 Dec 20 05:55:02.352863 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 34047432-9d11-4c88-b220-6401301b0066 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:55:02.466409 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7b2b232-102b-43bd-bcde-d56a7010b524 None None] Network ebca9b29-55b2-47f1-bcfb-6bced6fdc050 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:55:02.554795 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 34047432-9d11-4c88-b220-6401301b0066, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=34047432-9d11-4c88-b220-6401301b0066,segment=NetworkSegment(e75dfcc1-ca2a-46c6-a0aa-251ee070119b),segment_id=e75dfcc1-ca2a-46c6-a0aa-251ee070119b)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:02.572925 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '34047432-9d11-4c88-b220-6401301b0066', 'network_id': 'c26632c1-19ed-44a7-b956-a61862e2b6b0', 'port_id': '34047432-9d11-4c88-b220-6401301b0066', 'mac_address': 'fa:16:3e:66:0a:cf', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 432, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'af5b09fe-0910-495b-aaf9-ec3ee59fc9a5', 'ip_address': '192.168.233.60'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:55:02.634112 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:02.651534 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 34047432-9d11-4c88-b220-6401301b0066 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:55:02.677741 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 34047432-9d11-4c88-b220-6401301b0066, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=34047432-9d11-4c88-b220-6401301b0066,segment=NetworkSegment(e75dfcc1-ca2a-46c6-a0aa-251ee070119b),segment_id=e75dfcc1-ca2a-46c6-a0aa-251ee070119b)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:02.682283 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:02.732530 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=34047432-9d11-4c88-b220-6401301b0066,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:03.597132 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5885ce2e-81f5-4545-94b3-82aa4db8e8a3 req-d4e6bef0-65d2-4ed4-9755-942dc542c719 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:03.598759 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5885ce2e-81f5-4545-94b3-82aa4db8e8a3 req-d4e6bef0-65d2-4ed4-9755-942dc542c719 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 948 time: 0.1125031 Dec 20 05:55:03.660562 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-aaedcc93-a3bb-496d-b4bb-4439d35616c3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:03.661916 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-aaedcc93-a3bb-496d-b4bb-4439d35616c3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.54 "GET /v2.0/networks?id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a HTTP/1.1" status: 200 len: 819 time: 0.1491303 Dec 20 05:55:03.675426 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5885ce2e-81f5-4545-94b3-82aa4db8e8a3 req-84eb58e9-e02f-4510-9831-f7ca83037a51 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/security-groups?id=d98b6c59-460b-46cb-86b0-929b673ba2ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0687444 Dec 20 05:55:03.686380 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-15d7626f-7c17-4daa-840f-bfec7aa9bc78 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Request body: {'port': {'device_id': '3651bc83-8bde-4d1f-9102-e33780b728cd', 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a', 'admin_state_up': True, 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:03.701419 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['34047432-9d11-4c88-b220-6401301b0066'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:55:03.805147 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-15d7626f-7c17-4daa-840f-bfec7aa9bc78 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Made reservation on behalf of a2e9de0d64e642f08bf90d402e77baa3 for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:55:03.809792 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-15d7626f-7c17-4daa-840f-bfec7aa9bc78 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:03.815734 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device e33a1ab9-8ab9-480c-bbce-99e76e107aac up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:55:03.899973 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port e33a1ab9-8ab9-480c-bbce-99e76e107aac triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:03.900307 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:03.949369 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-15d7626f-7c17-4daa-840f-bfec7aa9bc78 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Allocated IP 172.20.0.8 (d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a/e1658c3d-4c2e-4687-a529-637456d3a81c/0a3d7cef-eb9c-4b58-965b-9e4878a9fa09) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:55:04.115180 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-15d7626f-7c17-4daa-840f-bfec7aa9bc78 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:04.148283 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-15d7626f-7c17-4daa-840f-bfec7aa9bc78 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:04.149130 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-06fef436-367f-4242-afcf-0950829877c9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:04.193227 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-15d7626f-7c17-4daa-840f-bfec7aa9bc78 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:55:04.196307 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-15d7626f-7c17-4daa-840f-bfec7aa9bc78 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:55:04.199856 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-15d7626f-7c17-4daa-840f-bfec7aa9bc78 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:55:04.222786 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15d7626f-7c17-4daa-840f-bfec7aa9bc78 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Pushing event updated for resources: {'Port': ['ID=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:04.253305 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-15d7626f-7c17-4daa-840f-bfec7aa9bc78 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:04.253963 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-15d7626f-7c17-4daa-840f-bfec7aa9bc78 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:04.274815 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-15d7626f-7c17-4daa-840f-bfec7aa9bc78 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5920973 Dec 20 05:55:04.306790 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Request body: {'port': {'device_id': '3651bc83-8bde-4d1f-9102-e33780b728cd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:04.364627 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:04.627522 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:55:04.634897 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:04.648508 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Transition to ACTIVE for port object 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 05:55:04.652966 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:04.706102 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Pushing event updated for resources: {'Port': ['ID=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:04.775459 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Attempting to bind port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:55:04.775815 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Attempting to bind port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:55:04.776139 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Attempting to bind port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 on network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:55:04.782179 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 on network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 05:55:04.782503 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Attempting to bind port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 on network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:55:04.787201 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 54, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:55:04.787559 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Checking segment: {'id': 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:55:04.787952 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Bound using segment: {'id': 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:55:04.788357 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Bound port: 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:55:04.788700 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:04.850382 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] For port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:55:04.853395 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] For port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09,segment=NetworkSegment(e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e),segment_id=e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:55:04.857532 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:04.893095 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:04.893702 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:04.895090 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] 10.222.0.54 "PUT /v2.0/ports/0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 HTTP/1.1" status: 200 len: 1093 time: 0.5926383 Dec 20 05:55:04.895549 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3651bc83-8bde-4d1f-9102-e33780b728cd', 'tag': '0a3d7cef-eb9c-4b58-965b-9e4878a9fa09'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:55:04.897768 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10bea562-1fb4-474a-9962-83800fc94d89" -d '{"events": [{"name": "network-changed", "server_uuid": "3651bc83-8bde-4d1f-9102-e33780b728cd", "tag": "0a3d7cef-eb9c-4b58-965b-9e4878a9fa09"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:55:04.917881 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65ff7e01-4dc1-41fb-8738-8ff1ebdcb8cc service neutron] Pushing event updated for resources: {'Port': ['ID=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:04.982642 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:05.004161 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-4a7b4df3-40c9-47ed-9ff8-227dd6a90750 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:05.005648 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-4a7b4df3-40c9-47ed-9ff8-227dd6a90750 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a2e9de0d64e642f08bf90d402e77baa3&device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 1096 time: 0.0449772 Dec 20 05:55:05.063542 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-84cf97f3-2b6b-44a4-86e0-d8e1aceb2632 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 HTTP/1.1" status: 200 len: 217 time: 0.0375447 Dec 20 05:55:05.112298 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-c272a7ff-e4b1-4ed8-98a9-c72474e9d716 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:05.113728 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-c272a7ff-e4b1-4ed8-98a9-c72474e9d716 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=e1658c3d-4c2e-4687-a529-637456d3a81c HTTP/1.1" status: 200 len: 859 time: 0.0433991 Dec 20 05:55:05.149455 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-014584bd-1c6f-4510-823c-374f36b3dec6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0266509 Dec 20 05:55:05.242178 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-59a6cdbe-9bd4-4301-ae82-2c29f74016d2 service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840530 Dec 20 05:55:05.333505 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81a3941d-6b09-466a-a1bb-a72e4c89c4c3 req-f50c14d0-9e20-48ba-94df-52e567e7346e service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834978 Dec 20 05:55:05.385065 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 34047432-9d11-4c88-b220-6401301b0066 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:55:05.439732 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port 34047432-9d11-4c88-b220-6401301b0066 completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 05:55:05.443697 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 34047432-9d11-4c88-b220-6401301b0066 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:05.444074 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:05.526510 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:05.555945 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ed0331a-2675-4de2-8b1f-02361c9c12f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '34047432-9d11-4c88-b220-6401301b0066'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:55:05.558183 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8d7db053-eca8-4535-b570-41925af97702" -d '{"events": [{"server_uuid": "8ed0331a-2675-4de2-8b1f-02361c9c12f7", "name": "network-vif-plugged", "status": "completed", "tag": "34047432-9d11-4c88-b220-6401301b0066"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:55:05.571810 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 34047432-9d11-4c88-b220-6401301b0066, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=34047432-9d11-4c88-b220-6401301b0066,segment=NetworkSegment(e75dfcc1-ca2a-46c6-a0aa-251ee070119b),segment_id=e75dfcc1-ca2a-46c6-a0aa-251ee070119b)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:05.576118 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:05.625897 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=34047432-9d11-4c88-b220-6401301b0066,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:06.460032 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:07.310295 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:07.571128 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:08.970645 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:55:08.978991 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 44704) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:09.082251 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8a39ae9f-1ea3-4c2f-a688-9e7beebd9428 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:09.156758 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8a39ae9f-1ea3-4c2f-a688-9e7beebd9428 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:09.162351 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8a39ae9f-1ea3-4c2f-a688-9e7beebd9428 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:09.200515 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-8a39ae9f-1ea3-4c2f-a688-9e7beebd9428 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=7d955978eda348d0ad852732e40bab73&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2204204 Dec 20 05:55:09.201403 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a39ae9f-1ea3-4c2f-a688-9e7beebd9428 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=71b337b6-fcb5-469e-b05e-867dd049bff6,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:09.203224 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 44708) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:09.258699 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-47ef3da9-de66-4d0d-b748-d29886ac1c09 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:09.279033 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-47ef3da9-de66-4d0d-b748-d29886ac1c09 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:09.329878 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-47ef3da9-de66-4d0d-b748-d29886ac1c09 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:09.332510 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-47ef3da9-de66-4d0d-b748-d29886ac1c09 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:09.333654 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-47ef3da9-de66-4d0d-b748-d29886ac1c09 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/71b337b6-fcb5-469e-b05e-867dd049bff6 HTTP/1.1" status: 204 len: 168 time: 0.1293988 Dec 20 05:55:09.341318 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef3da9-de66-4d0d-b748-d29886ac1c09 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=71b337b6-fcb5-469e-b05e-867dd049bff6,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:10.151282 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-632f1646-655e-4648-a7e1-e3c25c684b58 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:10.153359 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-632f1646-655e-4648-a7e1-e3c25c684b58 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/networks?id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a HTTP/1.1" status: 200 len: 819 time: 0.1939480 Dec 20 05:55:10.161318 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-9d1150e4-d023-4f6a-ae8e-8f13450ac909 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:10.162694 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-9d1150e4-d023-4f6a-ae8e-8f13450ac909 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/networks?id=ebca9b29-55b2-47f1-bcfb-6bced6fdc050 HTTP/1.1" status: 200 len: 809 time: 0.1907461 Dec 20 05:55:10.180020 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-036fe1fb-6e60-422e-bb34-7fdb0dae705d tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/quotas/a2e9de0d64e642f08bf90d402e77baa3 HTTP/1.1" status: 200 len: 375 time: 0.0164201 Dec 20 05:55:10.181550 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-2c154bec-2872-49ef-a493-f5f05b6863da tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/quotas/c55e4805e4ec461e98ab84a95a8755d7 HTTP/1.1" status: 200 len: 375 time: 0.0119004 Dec 20 05:55:10.234531 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-0fcdbb59-55a5-4331-bc6f-d4e2400b6bda tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=c55e4805e4ec461e98ab84a95a8755d7&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0469339 Dec 20 05:55:10.285427 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-7c3fa988-c35f-43e5-abf7-0b2d20716619 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=a2e9de0d64e642f08bf90d402e77baa3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0868146 Dec 20 05:55:10.402407 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-7487c96a-7d0f-4d31-843a-e35ce50b9df6 service neutron] 10.222.0.46 "GET /v2.0/networks/ebca9b29-55b2-47f1-bcfb-6bced6fdc050?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1600449 Dec 20 05:55:10.452917 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-f99fe631-bb0c-4e1d-b931-59283cde8ba8 service neutron] 10.222.0.46 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1373093 Dec 20 05:55:10.563490 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-03a8d069-3b98-4b9c-8fea-fcea44c53b42 service neutron] 10.222.0.46 "GET /v2.0/networks/ebca9b29-55b2-47f1-bcfb-6bced6fdc050?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1521988 Dec 20 05:55:10.585424 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-9b49d20b-c69b-4481-bf71-df7c8d64bf7d service neutron] 10.222.0.46 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1045680 Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.797132 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.799268 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.799268 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.799268 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.799268 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.799268 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.799268 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.799268 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.799268 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.799268 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.799268 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.799268 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:55:10.799268 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:55:10.803546 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c9d61fe-2d12-4a73-b6b4-432139347c20 req-0b33aaf5-7621-4b64-b3c9-15d4cfeec95f tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:10.805165 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3c9d61fe-2d12-4a73-b6b4-432139347c20 req-0b33aaf5-7621-4b64-b3c9-15d4cfeec95f tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 949 time: 0.0635986 Dec 20 05:55:10.833407 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:55:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5d1948fa-f787-405b-b7da-7d2f5b779418 x-openstack-request-id: req-5d1948fa-f787-405b-b7da-7d2f5b779418 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:55:10.833709 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3651bc83-8bde-4d1f-9102-e33780b728cd", "tag": "0a3d7cef-eb9c-4b58-965b-9e4878a9fa09", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:55:10.833971 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-5d1948fa-f787-405b-b7da-7d2f5b779418 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:55:10.834365 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3651bc83-8bde-4d1f-9102-e33780b728cd', 'tag': '0a3d7cef-eb9c-4b58-965b-9e4878a9fa09', 'status': 'completed', 'code': 200} Dec 20 05:55:10.880338 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3c9d61fe-2d12-4a73-b6b4-432139347c20 req-fff1c77a-f675-4bfd-b1e0-044b47ceb0cc tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/security-groups?id=d98b6c59-460b-46cb-86b0-929b673ba2ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645006 Dec 20 05:55:10.913500 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:55:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ae19ade-738d-44ab-bca6-cc56133b7401 x-openstack-request-id: req-1ae19ade-738d-44ab-bca6-cc56133b7401 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:55:10.913991 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ed0331a-2675-4de2-8b1f-02361c9c12f7", "name": "network-vif-plugged", "status": "completed", "tag": "34047432-9d11-4c88-b220-6401301b0066", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:55:10.914072 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-1ae19ade-738d-44ab-bca6-cc56133b7401 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:55:10.914439 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ed0331a-2675-4de2-8b1f-02361c9c12f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '34047432-9d11-4c88-b220-6401301b0066', 'code': 200} Dec 20 05:55:11.217103 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b274806-a341-4beb-a201-ece17553cd44 req-2c8effe0-a2c5-4f6b-a629-13f3bb91f53c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:11.218725 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-3b274806-a341-4beb-a201-ece17553cd44 req-2c8effe0-a2c5-4f6b-a629-13f3bb91f53c service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 1102 time: 0.0855253 Dec 20 05:55:11.226191 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-133d31eb-1745-486f-a73e-e6d61fd0e43c req-a42563e1-8f3a-490e-961e-d6ad6c9cd5a6 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 210 time: 0.2799721 Dec 20 05:55:11.236794 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7b205022-1577-47a8-b454-78158b3b2104 req-8a550fdc-f400-4492-a309-b2d5e31e8c87 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 210 time: 0.2705760 Dec 20 05:55:11.258619 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bea562-1fb4-474a-9962-83800fc94d89 req-c64ac709-75da-4dd3-9595-f6c4067579e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:11.260163 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-10bea562-1fb4-474a-9962-83800fc94d89 req-c64ac709-75da-4dd3-9595-f6c4067579e7 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a2e9de0d64e642f08bf90d402e77baa3&device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 1096 time: 0.3751390 Dec 20 05:55:11.296069 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-3b274806-a341-4beb-a201-ece17553cd44 req-f53df5e9-e3fa-4b1e-bd44-501a9039a5a2 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=d98b6c59-460b-46cb-86b0-929b673ba2ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698209 Dec 20 05:55:11.379454 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bea562-1fb4-474a-9962-83800fc94d89 req-2bbd16a2-04f8-4f08-ac9d-edfa54248b67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:11.381036 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-10bea562-1fb4-474a-9962-83800fc94d89 req-2bbd16a2-04f8-4f08-ac9d-edfa54248b67 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a HTTP/1.1" status: 200 len: 920 time: 0.1122932 Dec 20 05:55:11.401209 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:55:11.499829 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09,segment=NetworkSegment(e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e),segment_id=e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:11.510911 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '0a3d7cef-eb9c-4b58-965b-9e4878a9fa09', 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a', 'port_id': '0a3d7cef-eb9c-4b58-965b-9e4878a9fa09', 'mac_address': 'fa:16:3e:8e:2b:bb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 446, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e1658c3d-4c2e-4687-a529-637456d3a81c', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:55:11.549911 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:11.562814 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:55:11.583253 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09,segment=NetworkSegment(e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e),segment_id=e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:11.588079 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:11.649558 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:11.667843 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-10bea562-1fb4-474a-9962-83800fc94d89 req-58e8db30-a572-4a0a-9d44-ceaf47220c32 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 HTTP/1.1" status: 200 len: 217 time: 0.0475464 Dec 20 05:55:11.765324 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bea562-1fb4-474a-9962-83800fc94d89 req-3203cc91-9958-41ff-ba88-5fe6867fa197 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:11.766916 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-10bea562-1fb4-474a-9962-83800fc94d89 req-3203cc91-9958-41ff-ba88-5fe6867fa197 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=e1658c3d-4c2e-4687-a529-637456d3a81c HTTP/1.1" status: 200 len: 859 time: 0.0512106 Dec 20 05:55:11.847545 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-10bea562-1fb4-474a-9962-83800fc94d89 req-63d75756-9b8d-4b51-9a99-b9cd0f8bc429 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0267684 Dec 20 05:55:11.952786 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['0a3d7cef-eb9c-4b58-965b-9e4878a9fa09'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:55:12.002031 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-10bea562-1fb4-474a-9962-83800fc94d89 req-269438f3-573b-443a-bb4e-aa4e75dcb6d9 service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1449099 Dec 20 05:55:12.104512 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc766c9a-00cd-466d-ae09-42c450ab8e57 req-6a9713a6-7138-481d-93c8-bc1ecf8d7d2a tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:12.106055 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bc766c9a-00cd-466d-ae09-42c450ab8e57 req-6a9713a6-7138-481d-93c8-bc1ecf8d7d2a tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 949 time: 0.1031725 Dec 20 05:55:12.155252 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-10bea562-1fb4-474a-9962-83800fc94d89 req-b7d0d796-c40d-4f8a-88cd-480ba8ec349d service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1260364 Dec 20 05:55:12.169485 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bc766c9a-00cd-466d-ae09-42c450ab8e57 req-86ae2916-fcb7-4be8-a848-8e4f33dcf759 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/security-groups?id=d98b6c59-460b-46cb-86b0-929b673ba2ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574815 Dec 20 05:55:12.338252 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2a95f8f2-5eb7-4030-8b30-876d44ea9e82 req-aa7f7d28-6616-497c-b8b3-c43d62ce850e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 210 time: 0.0333319 Dec 20 05:55:12.352106 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0a4be0b0-a1fa-41bf-883f-b0fd168bf2d7 req-0520cb6e-dcfb-4b63-b045-4572b927d369 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 210 time: 0.0366063 Dec 20 05:55:12.617488 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-12258a64-8037-475c-845d-68f83ec2a930 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:12.618976 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-12258a64-8037-475c-845d-68f83ec2a930 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.54 "GET /v2.0/networks?id=ebca9b29-55b2-47f1-bcfb-6bced6fdc050 HTTP/1.1" status: 200 len: 809 time: 0.1124594 Dec 20 05:55:12.763078 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-2e77d336-4684-4351-8004-9d505150e2fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Request body: {'port': {'device_id': 'e2f58997-0d62-4c82-b6dc-ccaf39db4ef9', 'network_id': 'ebca9b29-55b2-47f1-bcfb-6bced6fdc050', 'admin_state_up': True, 'tenant_id': 'c55e4805e4ec461e98ab84a95a8755d7'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:12.880618 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-2e77d336-4684-4351-8004-9d505150e2fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Made reservation on behalf of c55e4805e4ec461e98ab84a95a8755d7 for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:55:12.884454 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-2e77d336-4684-4351-8004-9d505150e2fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:13.046251 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-2e77d336-4684-4351-8004-9d505150e2fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Allocated IP 172.20.0.3 (ebca9b29-55b2-47f1-bcfb-6bced6fdc050/2c54f9a1-64d2-45bf-94c0-c7d4cd8d6225/f17cacd6-5f1e-4b19-986d-0019b0b697cb) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:55:13.264402 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-2e77d336-4684-4351-8004-9d505150e2fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:13.313680 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-2e77d336-4684-4351-8004-9d505150e2fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:13.378148 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-2e77d336-4684-4351-8004-9d505150e2fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Network ebca9b29-55b2-47f1-bcfb-6bced6fdc050 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:55:13.394400 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d6e6d7-4c96-4f74-b5f2-6455fad0b9ee req-74519f32-2f95-4177-9369-016c6cae1870 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:13.395942 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d7d6e6d7-4c96-4f74-b5f2-6455fad0b9ee req-74519f32-2f95-4177-9369-016c6cae1870 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 949 time: 0.0965600 Dec 20 05:55:13.396848 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-2e77d336-4684-4351-8004-9d505150e2fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:55:13.401523 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-2e77d336-4684-4351-8004-9d505150e2fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:55:13.407575 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e77d336-4684-4351-8004-9d505150e2fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Pushing event updated for resources: {'Port': ['ID=f17cacd6-5f1e-4b19-986d-0019b0b697cb,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:13.423925 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:55:13.482667 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-54f74286-8121-417f-923b-ea1c43635260 req-3ae31a75-706a-4b4c-a234-fa40635b5399 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 210 time: 0.0276868 Dec 20 05:55:13.506915 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-2e77d336-4684-4351-8004-9d505150e2fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:13.507674 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-2e77d336-4684-4351-8004-9d505150e2fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:13.527141 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 05:55:13.527488 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d7d6e6d7-4c96-4f74-b5f2-6455fad0b9ee req-1821c206-2565-4e10-89b0-251d26113f16 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/security-groups?id=d98b6c59-460b-46cb-86b0-929b673ba2ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1226161 Dec 20 05:55:13.532226 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-2e77d336-4684-4351-8004-9d505150e2fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7732508 Dec 20 05:55:13.533247 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:13.533687 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:13.557329 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Request body: {'port': {'device_id': 'e2f58997-0d62-4c82-b6dc-ccaf39db4ef9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:13.563235 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-7fdbbb5d-5913-43e7-95b7-2cd69d9701e8 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:13.565796 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-7fdbbb5d-5913-43e7-95b7-2cd69d9701e8 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.54 "GET /v2.0/networks?id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a HTTP/1.1" status: 200 len: 819 time: 0.1831264 Dec 20 05:55:13.593366 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-cf58c594-2995-48fa-9d9e-014e75c3504b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Request body: {'port': {'device_id': '66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3', 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a', 'admin_state_up': True, 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:13.660999 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:13.679136 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a73e8fe6-a96e-4110-ae71-33986adc63da req-55c4d496-5e21-4e97-9dc8-869271f204bc tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:13.680757 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a73e8fe6-a96e-4110-ae71-33986adc63da req-55c4d496-5e21-4e97-9dc8-869271f204bc tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 931 time: 0.0908799 Dec 20 05:55:13.697884 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:13.729137 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3651bc83-8bde-4d1f-9102-e33780b728cd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0a3d7cef-eb9c-4b58-965b-9e4878a9fa09'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:55:13.732538 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8d53b8be-d16c-4542-ae04-8414e8570cc2" -d '{"events": [{"server_uuid": "3651bc83-8bde-4d1f-9102-e33780b728cd", "name": "network-vif-plugged", "status": "completed", "tag": "0a3d7cef-eb9c-4b58-965b-9e4878a9fa09"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:55:13.747870 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-cf58c594-2995-48fa-9d9e-014e75c3504b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Made reservation on behalf of a2e9de0d64e642f08bf90d402e77baa3 for: {'port': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:55:13.749147 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09,segment=NetworkSegment(e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e),segment_id=e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:13.756068 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:13.761399 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-cf58c594-2995-48fa-9d9e-014e75c3504b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:13.768462 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a73e8fe6-a96e-4110-ae71-33986adc63da req-4a08a1a0-94ba-43e2-bde9-a402d08a331a tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0808060 Dec 20 05:55:13.839130 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:55:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-850ea816-4ec9-43a9-be75-ae51da627b7c x-openstack-request-id: req-850ea816-4ec9-43a9-be75-ae51da627b7c {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:55:13.839443 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3651bc83-8bde-4d1f-9102-e33780b728cd", "name": "network-vif-plugged", "status": "completed", "tag": "0a3d7cef-eb9c-4b58-965b-9e4878a9fa09", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:55:13.839767 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-850ea816-4ec9-43a9-be75-ae51da627b7c {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:55:13.840685 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3651bc83-8bde-4d1f-9102-e33780b728cd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0a3d7cef-eb9c-4b58-965b-9e4878a9fa09', 'code': 200} Dec 20 05:55:13.857823 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:13.931742 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-cf58c594-2995-48fa-9d9e-014e75c3504b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Allocated IP 172.20.0.2 (d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a/e1658c3d-4c2e-4687-a529-637456d3a81c/43ed8d1a-ee0a-4df9-9df5-1c14a02f642c) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:55:13.975155 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43bebe49-76ab-46bf-a1e3-06b944fd835a req-74703296-aa6a-40da-a3dd-55039153bf0f tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:13.976688 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-43bebe49-76ab-46bf-a1e3-06b944fd835a req-74703296-aa6a-40da-a3dd-55039153bf0f tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 949 time: 0.0939705 Dec 20 05:55:14.073067 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-43bebe49-76ab-46bf-a1e3-06b944fd835a req-45c06530-fbde-44da-9852-e04fde985952 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/security-groups?id=d98b6c59-460b-46cb-86b0-929b673ba2ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0861790 Dec 20 05:55:14.090314 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f17cacd6-5f1e-4b19-986d-0019b0b697cb {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:55:14.099604 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:14.112129 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Transition to ACTIVE for port object f17cacd6-5f1e-4b19-986d-0019b0b697cb will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 05:55:14.115279 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:14.122118 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-cf58c594-2995-48fa-9d9e-014e75c3504b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:14.127631 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.54', 56993) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:14.166935 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Pushing event updated for resources: {'Port': ['ID=f17cacd6-5f1e-4b19-986d-0019b0b697cb,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:14.189792 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-176f02b8-6c46-4c03-a235-7d7744a6209d req-0d5fe225-3417-4b95-8a2f-1ed2785c765f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:14.191275 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-176f02b8-6c46-4c03-a235-7d7744a6209d req-0d5fe225-3417-4b95-8a2f-1ed2785c765f service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 1098 time: 0.0615098 Dec 20 05:55:14.192678 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-cf58c594-2995-48fa-9d9e-014e75c3504b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:14.239207 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Attempting to bind port f17cacd6-5f1e-4b19-986d-0019b0b697cb on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:55:14.239569 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Attempting to bind port f17cacd6-5f1e-4b19-986d-0019b0b697cb by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': 'e86c45d4-b3d7-41e1-892c-83dec0fca686', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': 'ebca9b29-55b2-47f1-bcfb-6bced6fdc050'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:55:14.239904 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Attempting to bind port f17cacd6-5f1e-4b19-986d-0019b0b697cb on network ebca9b29-55b2-47f1-bcfb-6bced6fdc050 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:55:14.245671 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Port f17cacd6-5f1e-4b19-986d-0019b0b697cb on network ebca9b29-55b2-47f1-bcfb-6bced6fdc050 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 05:55:14.246517 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Attempting to bind port f17cacd6-5f1e-4b19-986d-0019b0b697cb on network ebca9b29-55b2-47f1-bcfb-6bced6fdc050 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:55:14.252047 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['0a3d7cef-eb9c-4b58-965b-9e4878a9fa09'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:55:14.252718 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 55, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:55:14.253093 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Checking segment: {'id': 'e86c45d4-b3d7-41e1-892c-83dec0fca686', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': 'ebca9b29-55b2-47f1-bcfb-6bced6fdc050'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:55:14.253486 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Bound using segment: {'id': 'e86c45d4-b3d7-41e1-892c-83dec0fca686', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': 'ebca9b29-55b2-47f1-bcfb-6bced6fdc050'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:55:14.254058 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Bound port: f17cacd6-5f1e-4b19-986d-0019b0b697cb, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e86c45d4-b3d7-41e1-892c-83dec0fca686', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': 'ebca9b29-55b2-47f1-bcfb-6bced6fdc050'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:55:14.254337 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:14.259264 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-cf58c594-2995-48fa-9d9e-014e75c3504b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:55:14.265482 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-cf58c594-2995-48fa-9d9e-014e75c3504b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:55:14.267593 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf58c594-2995-48fa-9d9e-014e75c3504b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Pushing event updated for resources: {'Port': ['ID=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:14.271847 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-cf58c594-2995-48fa-9d9e-014e75c3504b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:55:14.333766 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-176f02b8-6c46-4c03-a235-7d7744a6209d req-a64d954c-5746-4f83-830d-6965a5b5cae7 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1084499 Dec 20 05:55:14.348803 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] For port f17cacd6-5f1e-4b19-986d-0019b0b697cb, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:55:14.354351 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] For port f17cacd6-5f1e-4b19-986d-0019b0b697cb, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=f17cacd6-5f1e-4b19-986d-0019b0b697cb,segment=NetworkSegment(e86c45d4-b3d7-41e1-892c-83dec0fca686),segment_id=e86c45d4-b3d7-41e1-892c-83dec0fca686)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:55:14.359928 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:14.383273 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-cf58c594-2995-48fa-9d9e-014e75c3504b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:14.386094 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-cf58c594-2995-48fa-9d9e-014e75c3504b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:14.418675 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-cf58c594-2995-48fa-9d9e-014e75c3504b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8299208 Dec 20 05:55:14.420057 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:14.420733 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:14.422353 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] 10.222.0.54 "PUT /v2.0/ports/f17cacd6-5f1e-4b19-986d-0019b0b697cb HTTP/1.1" status: 200 len: 1093 time: 0.8698750 Dec 20 05:55:14.422801 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e2f58997-0d62-4c82-b6dc-ccaf39db4ef9', 'tag': 'f17cacd6-5f1e-4b19-986d-0019b0b697cb'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:55:14.425550 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-567e6256-b5ba-4a49-942c-cabf94df7df6" -d '{"events": [{"name": "network-changed", "server_uuid": "e2f58997-0d62-4c82-b6dc-ccaf39db4ef9", "tag": "f17cacd6-5f1e-4b19-986d-0019b0b697cb"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:55:14.484524 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e8ef9d6-146c-4c61-b953-cb9fc594c31c service neutron] Pushing event updated for resources: {'Port': ['ID=f17cacd6-5f1e-4b19-986d-0019b0b697cb,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:14.488141 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:55:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-200f5b2c-2007-4af5-9254-19a023c9d547 x-openstack-request-id: req-200f5b2c-2007-4af5-9254-19a023c9d547 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:55:14.488432 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e2f58997-0d62-4c82-b6dc-ccaf39db4ef9", "tag": "f17cacd6-5f1e-4b19-986d-0019b0b697cb", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:55:14.488686 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-200f5b2c-2007-4af5-9254-19a023c9d547 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:55:14.489076 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e2f58997-0d62-4c82-b6dc-ccaf39db4ef9', 'tag': 'f17cacd6-5f1e-4b19-986d-0019b0b697cb', 'status': 'completed', 'code': 200} Dec 20 05:55:14.605266 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7ad78c-47b5-4837-b6f9-f40ecccd92fd req-c101c23d-4324-4969-8038-8a80606c1660 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:14.606753 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e7ad78c-47b5-4837-b6f9-f40ecccd92fd req-c101c23d-4324-4969-8038-8a80606c1660 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 931 time: 0.0521252 Dec 20 05:55:14.653320 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e7ad78c-47b5-4837-b6f9-f40ecccd92fd req-d1827482-184b-4f40-a7d2-268f3d577acd tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405524 Dec 20 05:55:14.810755 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Request body: {'port': {'device_id': '66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:14.875080 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:14.918139 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5dab402-7652-4d1f-a65d-518b753db620 req-013df9d8-dba9-49df-8a9b-f356981ccbbd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:14.919766 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e5dab402-7652-4d1f-a65d-518b753db620 req-013df9d8-dba9-49df-8a9b-f356981ccbbd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 943 time: 0.0786476 Dec 20 05:55:14.940302 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567e6256-b5ba-4a49-942c-cabf94df7df6 req-ca5ad35d-26d0-4fa7-893f-8ff8c62df118 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:14.940691 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-567e6256-b5ba-4a49-942c-cabf94df7df6 req-ca5ad35d-26d0-4fa7-893f-8ff8c62df118 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=c55e4805e4ec461e98ab84a95a8755d7&device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 1096 time: 0.0719860 Dec 20 05:55:15.028861 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e5dab402-7652-4d1f-a65d-518b753db620 req-d718717f-d753-445a-b4bc-944bb39e2511 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1020460 Dec 20 05:55:15.198540 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c {{(pid=102446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:55:15.207848 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:15.208914 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567e6256-b5ba-4a49-942c-cabf94df7df6 req-775f59de-1be2-4061-9ef1-30899a850f57 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:15.210560 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-567e6256-b5ba-4a49-942c-cabf94df7df6 req-775f59de-1be2-4061-9ef1-30899a850f57 service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=c55e4805e4ec461e98ab84a95a8755d7&shared=False HTTP/1.1" status: 200 len: 910 time: 0.2474964 Dec 20 05:55:15.224223 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.provisioning_blocks [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Transition to ACTIVE for port object 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c will not be triggered until provisioned by entity L2. {{(pid=102446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 05:55:15.228511 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:15.279781 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2110a3-f0cf-4f2b-9d26-4782fe10c1b8 req-a245c40b-bb98-442a-97df-8ccaae66c848 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:15.281318 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8a2110a3-f0cf-4f2b-9d26-4782fe10c1b8 req-a245c40b-bb98-442a-97df-8ccaae66c848 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 949 time: 0.1063957 Dec 20 05:55:15.284822 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Pushing event updated for resources: {'Port': ['ID=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:15.353245 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Attempting to bind port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:55:15.353825 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Attempting to bind port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a'}] {{(pid=102446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:55:15.354500 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Attempting to bind port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c on network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:55:15.360288 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c on network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 05:55:15.360613 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Attempting to bind port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c on network d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:55:15.365897 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 55, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:55:15.366364 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Checking segment: {'id': 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:55:15.366757 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Bound using segment: {'id': 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a'} {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:55:15.367195 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Bound port: 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a'}}] {{(pid=102446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:55:15.367563 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:15.422788 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8a2110a3-f0cf-4f2b-9d26-4782fe10c1b8 req-171a5b0e-6354-439c-a636-bc89d8fbbeb2 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/security-groups?id=d98b6c59-460b-46cb-86b0-929b673ba2ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1306567 Dec 20 05:55:15.427362 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567e6256-b5ba-4a49-942c-cabf94df7df6 req-cc201fd0-dc4f-42d1-99b9-d4d432129401 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:15.428905 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-567e6256-b5ba-4a49-942c-cabf94df7df6 req-cc201fd0-dc4f-42d1-99b9-d4d432129401 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2095320 Dec 20 05:55:15.450936 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] For port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c, host hv-cinder-82227, cleared binding levels {{(pid=102446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:55:15.454020 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] For port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c,segment=NetworkSegment(e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e),segment_id=e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e)] {{(pid=102446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:55:15.458814 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:15.491691 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:15.492318 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:15.493702 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] 10.222.0.54 "PUT /v2.0/ports/43ed8d1a-ee0a-4df9-9df5-1c14a02f642c HTTP/1.1" status: 200 len: 1093 time: 0.6880970 Dec 20 05:55:15.494135 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3', 'tag': '43ed8d1a-ee0a-4df9-9df5-1c14a02f642c'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:55:15.497042 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-875d4896-ca82-4896-b568-c69bbdfa0782" -d '{"events": [{"name": "network-changed", "server_uuid": "66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3", "tag": "43ed8d1a-ee0a-4df9-9df5-1c14a02f642c"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:55:15.540141 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:55:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2188f640-9fac-4a7a-bc99-a89d50110b45 x-openstack-request-id: req-2188f640-9fac-4a7a-bc99-a89d50110b45 {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:55:15.540437 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3", "tag": "43ed8d1a-ee0a-4df9-9df5-1c14a02f642c", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:55:15.540698 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-2188f640-9fac-4a7a-bc99-a89d50110b45 {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:55:15.541089 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3', 'tag': '43ed8d1a-ee0a-4df9-9df5-1c14a02f642c', 'status': 'completed', 'code': 200} Dec 20 05:55:15.561923 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d27553cb-3d78-4958-9c65-25bc4ef163d9 service neutron] Pushing event updated for resources: {'Port': ['ID=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c,revision_number=3']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:15.577051 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-ec354545-90af-46d2-949d-891270623fd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:15.578645 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-ec354545-90af-46d2-949d-891270623fd7 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=c55e4805e4ec461e98ab84a95a8755d7&device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 1096 time: 0.0545480 Dec 20 05:55:15.649343 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d94e06ae-51be-4ad1-a130-42a1069377ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:15.650944 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-d94e06ae-51be-4ad1-a130-42a1069377ed service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a2e9de0d64e642f08bf90d402e77baa3&device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 1096 time: 0.0422628 Dec 20 05:55:15.653457 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-06774c8d-255e-4cac-9596-d08e86e346be service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f17cacd6-5f1e-4b19-986d-0019b0b697cb HTTP/1.1" status: 200 len: 217 time: 0.0450292 Dec 20 05:55:15.775152 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63319e18-1789-4032-949b-1352f3ccbea3 req-4470a582-96a7-41cf-b7bd-31eac8074491 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:15.776777 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-63319e18-1789-4032-949b-1352f3ccbea3 req-4470a582-96a7-41cf-b7bd-31eac8074491 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 943 time: 0.0530646 Dec 20 05:55:15.842359 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-768d2600-1733-484f-a9df-8e07cf15cb76 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c HTTP/1.1" status: 200 len: 217 time: 0.0444381 Dec 20 05:55:15.843269 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-98c716b2-0b44-488b-885e-7fb62daa4beb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:15.844929 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-98c716b2-0b44-488b-885e-7fb62daa4beb service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2c54f9a1-64d2-45bf-94c0-c7d4cd8d6225 HTTP/1.1" status: 200 len: 849 time: 0.0495865 Dec 20 05:55:15.876192 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-63319e18-1789-4032-949b-1352f3ccbea3 req-be19e99b-bbbe-49e4-8a7f-902c8f12311a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0918281 Dec 20 05:55:15.892779 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-b69e3057-8a9c-45f7-b8ed-067492f252ff service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ebca9b29-55b2-47f1-bcfb-6bced6fdc050&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0287821 Dec 20 05:55:15.921591 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-8cc5a98c-5bf5-452c-89fd-ed425642e5a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:15.923040 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-8cc5a98c-5bf5-452c-89fd-ed425642e5a4 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=e1658c3d-4c2e-4687-a529-637456d3a81c HTTP/1.1" status: 200 len: 859 time: 0.0595155 Dec 20 05:55:16.007105 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-5fda356f-f05a-47ca-9b6f-4d1e5dd4c35f service neutron] 10.222.0.54 "GET /v2.0/networks/ebca9b29-55b2-47f1-bcfb-6bced6fdc050?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856109 Dec 20 05:55:16.107703 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-0bc971b6-09e6-4837-81ba-4d495085d4a1 req-87f901e6-a1ff-4504-8a78-15f7df225421 service neutron] 10.222.0.54 "GET /v2.0/networks/ebca9b29-55b2-47f1-bcfb-6bced6fdc050?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0918026 Dec 20 05:55:16.205365 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-18a5b5f3-b182-421b-82ce-d54f2d87d765 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2322469 Dec 20 05:55:16.301309 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6349f407-12ec-4d22-a5eb-b3b3016e9964 req-3d9ea461-2076-4bc1-b016-69ad8d949b29 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:16.302758 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6349f407-12ec-4d22-a5eb-b3b3016e9964 req-3d9ea461-2076-4bc1-b016-69ad8d949b29 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 943 time: 0.1003826 Dec 20 05:55:16.353045 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-0ed7a16c-508f-466b-bb72-88d4bc8e1aa1 service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1244454 Dec 20 05:55:16.374873 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6349f407-12ec-4d22-a5eb-b3b3016e9964 req-2809129a-fa4f-4937-b2dd-8e7d4a42a541 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0641942 Dec 20 05:55:16.448352 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42735386-3c31-43d6-8d53-6ea0bc747f2a req-01355510-78e2-435a-afb2-bad808bbf94c service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856829 Dec 20 05:55:16.549549 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8feddee-0cfc-4c2b-b4c8-669adbd66ea2 req-e99b5170-d4ce-49b8-a5aa-816afab074fd tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:16.551101 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d8feddee-0cfc-4c2b-b4c8-669adbd66ea2 req-e99b5170-d4ce-49b8-a5aa-816afab074fd tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 949 time: 0.0535994 Dec 20 05:55:16.599202 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d8feddee-0cfc-4c2b-b4c8-669adbd66ea2 req-d4a20e16-540f-4042-8760-3487405e84ed tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/security-groups?id=d98b6c59-460b-46cb-86b0-929b673ba2ca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419159 Dec 20 05:55:16.767262 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875d4896-ca82-4896-b568-c69bbdfa0782 req-e551d028-dc04-4932-86a9-9c67c1cb6972 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:16.768700 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-875d4896-ca82-4896-b568-c69bbdfa0782 req-e551d028-dc04-4932-86a9-9c67c1cb6972 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a2e9de0d64e642f08bf90d402e77baa3&device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 1096 time: 0.0407293 Dec 20 05:55:16.853353 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c06e464-6efa-4901-925b-3235b72ff024 req-5b04c47c-4a0b-46db-9f63-2869baaacf34 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:16.854872 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-6c06e464-6efa-4901-925b-3235b72ff024 req-5b04c47c-4a0b-46db-9f63-2869baaacf34 tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.54 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 949 time: 0.0878110 Dec 20 05:55:16.872108 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875d4896-ca82-4896-b568-c69bbdfa0782 req-9fcc58c6-edb9-46e5-b138-cd4ddfc048a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:16.874228 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-875d4896-ca82-4896-b568-c69bbdfa0782 req-9fcc58c6-edb9-46e5-b138-cd4ddfc048a7 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a HTTP/1.1" status: 200 len: 920 time: 0.0976906 Dec 20 05:55:16.918350 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-875d4896-ca82-4896-b568-c69bbdfa0782 req-f34c59b6-f159-4739-8c6b-fe25a7d66857 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c HTTP/1.1" status: 200 len: 217 time: 0.0344110 Dec 20 05:55:17.009668 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875d4896-ca82-4896-b568-c69bbdfa0782 req-fa2010f8-6166-47d6-8928-4441f3b33209 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:17.011147 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-875d4896-ca82-4896-b568-c69bbdfa0782 req-fa2010f8-6166-47d6-8928-4441f3b33209 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=e1658c3d-4c2e-4687-a529-637456d3a81c HTTP/1.1" status: 200 len: 859 time: 0.0856316 Dec 20 05:55:17.024202 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c20e926-9f20-4282-a562-8fc868c9f111 req-637148de-f512-4941-ba51-9b1c594782db tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:17.025637 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5c20e926-9f20-4282-a562-8fc868c9f111 req-637148de-f512-4941-ba51-9b1c594782db tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 943 time: 0.0666785 Dec 20 05:55:17.031747 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-6c06e464-6efa-4901-925b-3235b72ff024 req-c8e1e64d-694e-432a-a08b-cd16d514af0d tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Deleting port 34047432-9d11-4c88-b220-6401301b0066 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:55:17.032084 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-6c06e464-6efa-4901-925b-3235b72ff024 req-c8e1e64d-694e-432a-a08b-cd16d514af0d tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:17.055339 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-875d4896-ca82-4896-b568-c69bbdfa0782 req-a1e88c98-1161-499d-a7e3-aea790524fb4 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0287085 Dec 20 05:55:17.135807 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5c20e926-9f20-4282-a562-8fc868c9f111 req-2c630530-3ffc-4872-8b52-775eaf23d4ef tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1014221 Dec 20 05:55:17.151376 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-6c06e464-6efa-4901-925b-3235b72ff024 req-c8e1e64d-694e-432a-a08b-cd16d514af0d tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] For port 34047432-9d11-4c88-b220-6401301b0066, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=34047432-9d11-4c88-b220-6401301b0066,segment=NetworkSegment(e75dfcc1-ca2a-46c6-a0aa-251ee070119b),segment_id=e75dfcc1-ca2a-46c6-a0aa-251ee070119b)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:17.151792 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-6c06e464-6efa-4901-925b-3235b72ff024 req-c8e1e64d-694e-432a-a08b-cd16d514af0d tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:17.172501 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-6c06e464-6efa-4901-925b-3235b72ff024 req-c8e1e64d-694e-432a-a08b-cd16d514af0d tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Calling delete_port for 34047432-9d11-4c88-b220-6401301b0066 owned by compute:nova {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:55:17.221459 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-875d4896-ca82-4896-b568-c69bbdfa0782 req-82eeff25-69a0-4eec-911e-dcbe3e2c62e4 service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1484582 Dec 20 05:55:17.324156 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-875d4896-ca82-4896-b568-c69bbdfa0782 req-73f18b7a-029e-4cb0-aa46-268a5aab2830 service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0943251 Dec 20 05:55:17.365774 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-6c06e464-6efa-4901-925b-3235b72ff024 req-c8e1e64d-694e-432a-a08b-cd16d514af0d tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:17.394642 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8e1e64d-694e-432a-a08b-cd16d514af0d tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Pushing event deleted for resources: {'Port': ['ID=34047432-9d11-4c88-b220-6401301b0066,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:17.404602 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['34047432-9d11-4c88-b220-6401301b0066'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:55:17.457625 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-6c06e464-6efa-4901-925b-3235b72ff024 req-c8e1e64d-694e-432a-a08b-cd16d514af0d tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] No DVR routers for this DVR port 34047432-9d11-4c88-b220-6401301b0066 on host hv-cinder-82227 {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 05:55:17.460600 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-6c06e464-6efa-4901-925b-3235b72ff024 req-c8e1e64d-694e-432a-a08b-cd16d514af0d tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:17.464224 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-6c06e464-6efa-4901-925b-3235b72ff024 req-c8e1e64d-694e-432a-a08b-cd16d514af0d tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.54 "DELETE /v2.0/ports/34047432-9d11-4c88-b220-6401301b0066 HTTP/1.1" status: 204 len: 173 time: 0.6028509 Dec 20 05:55:17.522511 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a99c6c-df58-47f7-838d-71d6295c1d86 req-a2cbbeb2-e6b0-4a96-90c5-1e3c410001c6 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:17.530275 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-17a99c6c-df58-47f7-838d-71d6295c1d86 req-a2cbbeb2-e6b0-4a96-90c5-1e3c410001c6 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 943 time: 0.0617940 Dec 20 05:55:17.544311 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ed0331a-2675-4de2-8b1f-02361c9c12f7', 'name': 'network-vif-deleted', 'tag': '34047432-9d11-4c88-b220-6401301b0066'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:55:17.546989 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f7a5d9a5-6467-4e97-90ce-6a2ae29e3f13" -d '{"events": [{"server_uuid": "8ed0331a-2675-4de2-8b1f-02361c9c12f7", "name": "network-vif-deleted", "tag": "34047432-9d11-4c88-b220-6401301b0066"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:55:17.594589 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:55:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-410c7f12-585e-43cb-94cc-8371a19299cf x-openstack-request-id: req-410c7f12-585e-43cb-94cc-8371a19299cf {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:55:17.594963 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ed0331a-2675-4de2-8b1f-02361c9c12f7", "name": "network-vif-deleted", "tag": "34047432-9d11-4c88-b220-6401301b0066", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:55:17.595434 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-410c7f12-585e-43cb-94cc-8371a19299cf {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:55:17.595826 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ed0331a-2675-4de2-8b1f-02361c9c12f7', 'name': 'network-vif-deleted', 'tag': '34047432-9d11-4c88-b220-6401301b0066', 'status': 'completed', 'code': 200} Dec 20 05:55:17.618725 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-17a99c6c-df58-47f7-838d-71d6295c1d86 req-e07566b0-71d9-465f-b096-4122af8abdb9 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0875397 Dec 20 05:55:17.736188 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42c00d23-967b-46d8-8655-05030eceeaa4 req-bc0bdcf1-6746-49d2-9d16-5b9b0e77b73d tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 210 time: 0.0266709 Dec 20 05:55:18.243170 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11127fe7-e63f-4419-aa4e-39099e9dfa11 req-2632314a-beec-4098-87b4-575b4d9fecfc tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:18.244939 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-11127fe7-e63f-4419-aa4e-39099e9dfa11 req-2632314a-beec-4098-87b4-575b4d9fecfc tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 943 time: 0.0546188 Dec 20 05:55:18.295079 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-11127fe7-e63f-4419-aa4e-39099e9dfa11 req-45ac2213-3acb-4bf2-9eed-cd15be180a46 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439851 Dec 20 05:55:18.756653 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ec88d31-c407-46b3-b342-0c78f22e7002 req-aa6485e3-c732-42e2-995b-e2802ff1e748 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:18.756653 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9ec88d31-c407-46b3-b342-0c78f22e7002 req-aa6485e3-c732-42e2-995b-e2802ff1e748 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 943 time: 0.0501292 Dec 20 05:55:18.806180 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9ec88d31-c407-46b3-b342-0c78f22e7002 req-83d7436a-7860-4073-aea3-5461f47c952c tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461323 Dec 20 05:55:18.846451 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4c320882-c81d-44c5-8a4e-af7c6adef145 req-e7accb20-b37c-4df2-98b0-6ab60871c69c tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 210 time: 0.0264225 Dec 20 05:55:19.410466 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-885f84d5-cdad-4e59-9712-66c131cbca7c req-ff10c669-a769-4f5e-be18-8fb6eda87f00 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:19.411992 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-885f84d5-cdad-4e59-9712-66c131cbca7c req-ff10c669-a769-4f5e-be18-8fb6eda87f00 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 943 time: 0.0504403 Dec 20 05:55:19.458671 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-885f84d5-cdad-4e59-9712-66c131cbca7c req-7a9522b8-ad52-4c72-afc4-6537c7e6e203 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404618 Dec 20 05:55:19.917879 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc32ee51-9393-45c7-ae78-30cbd573e1b6 req-c9a41d47-5822-43c2-984f-95deda5a06f0 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:19.919367 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc32ee51-9393-45c7-ae78-30cbd573e1b6 req-c9a41d47-5822-43c2-984f-95deda5a06f0 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 943 time: 0.0477629 Dec 20 05:55:19.963899 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-17a130e9-d408-4114-ad4f-24e4911915d4 req-202e4336-5c67-4874-9e1f-0191e3b8447c tempest-VolumesNegativeTest-765645178 tempest-VolumesNegativeTest-765645178-project] 10.222.0.46 "GET /v2.0/ports?device_id=8ed0331a-2675-4de2-8b1f-02361c9c12f7 HTTP/1.1" status: 200 len: 210 time: 0.0396376 Dec 20 05:55:19.995217 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc32ee51-9393-45c7-ae78-30cbd573e1b6 req-14e9e068-4c68-4a00-8ed5-394713307d2f tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699577 Dec 20 05:55:20.567446 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:55:20.575143 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb9044a1-5209-4596-b3d2-239ca4845c49 req-50df1885-47ec-47aa-ab05-f45ae86c8238 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:20.576674 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cb9044a1-5209-4596-b3d2-239ca4845c49 req-50df1885-47ec-47aa-ab05-f45ae86c8238 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 943 time: 0.0465214 Dec 20 05:55:20.590311 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 34047432-9d11-4c88-b220-6401301b0066 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:55:20.630743 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: 34047432-9d11-4c88-b220-6401301b0066 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:55:20.631091 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 34047432-9d11-4c88-b220-6401301b0066 not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:55:20.637594 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cb9044a1-5209-4596-b3d2-239ca4845c49 req-776bf30a-4168-473d-bcc3-a835a7a1a180 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499299 Dec 20 05:55:20.694385 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c,segment=NetworkSegment(e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e),segment_id=e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:20.707976 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '43ed8d1a-ee0a-4df9-9df5-1c14a02f642c', 'network_id': 'd3f6e1ed-09e8-42e4-9c32-0efbc8cd603a', 'port_id': '43ed8d1a-ee0a-4df9-9df5-1c14a02f642c', 'mac_address': 'fa:16:3e:a8:c5:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 446, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e1658c3d-4c2e-4687-a529-637456d3a81c', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:55:20.745714 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:20.758653 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:55:20.778380 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c,segment=NetworkSegment(e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e),segment_id=e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:20.781941 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:20.827248 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:21.112968 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['43ed8d1a-ee0a-4df9-9df5-1c14a02f642c'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:55:21.115033 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46828a5e-7eda-4513-bf7f-a7f1e132dce9 req-501c47ec-d6a0-4a9a-9432-d71badecdcfe tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:21.117294 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46828a5e-7eda-4513-bf7f-a7f1e132dce9 req-501c47ec-d6a0-4a9a-9432-d71badecdcfe tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 943 time: 0.0546019 Dec 20 05:55:21.173896 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46828a5e-7eda-4513-bf7f-a7f1e132dce9 req-170bd555-732a-4d66-9079-7b3d1eacb696 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513711 Dec 20 05:55:21.759008 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-237e9ba3-42af-4c75-9c32-42758988a12f req-6112b595-aadf-4f0e-a080-ddeddc331275 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:21.761410 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-237e9ba3-42af-4c75-9c32-42758988a12f req-6112b595-aadf-4f0e-a080-ddeddc331275 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 944 time: 0.0558457 Dec 20 05:55:21.812686 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-237e9ba3-42af-4c75-9c32-42758988a12f req-37cc300e-8fb6-4f3b-ac9a-4dc581b459e6 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449343 Dec 20 05:55:22.134431 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 45130) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:22.294150 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9668ad5f-5f19-423b-b1e4-44f185f2fb73 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:22.300157 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a614ea63-e386-477d-9ea1-91dddf436dcc req-a403bd1d-63cb-4e80-b504-62395a0520df tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:22.302149 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a614ea63-e386-477d-9ea1-91dddf436dcc req-a403bd1d-63cb-4e80-b504-62395a0520df tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 943 time: 0.0544755 Dec 20 05:55:22.364411 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a614ea63-e386-477d-9ea1-91dddf436dcc req-ac4593f9-39ca-4279-a1ca-d043fa5fbbdf tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0562990 Dec 20 05:55:22.375272 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9668ad5f-5f19-423b-b1e4-44f185f2fb73 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:22.389122 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9668ad5f-5f19-423b-b1e4-44f185f2fb73 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:22.428688 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-9668ad5f-5f19-423b-b1e4-44f185f2fb73 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=6503063c1dbe4597a76610d0ec703159&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2931612 Dec 20 05:55:22.429564 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9668ad5f-5f19-423b-b1e4-44f185f2fb73 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=90869547-599a-4a4d-a7a1-1c6a596efdef,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:22.431400 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 45152) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:22.487627 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-857401a4-c879-4d6f-86c4-af0f8ef2bd2e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:22.509747 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-857401a4-c879-4d6f-86c4-af0f8ef2bd2e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:22.574324 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device f17cacd6-5f1e-4b19-986d-0019b0b697cb details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:55:22.579835 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-857401a4-c879-4d6f-86c4-af0f8ef2bd2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:22.583030 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-857401a4-c879-4d6f-86c4-af0f8ef2bd2e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:22.584305 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-857401a4-c879-4d6f-86c4-af0f8ef2bd2e admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/90869547-599a-4a4d-a7a1-1c6a596efdef HTTP/1.1" status: 204 len: 168 time: 0.1515939 Dec 20 05:55:22.594495 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-857401a4-c879-4d6f-86c4-af0f8ef2bd2e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=90869547-599a-4a4d-a7a1-1c6a596efdef,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:22.597987 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:55:22.692253 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 05:55:22.698332 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:22.699494 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:22.829881 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port f17cacd6-5f1e-4b19-986d-0019b0b697cb, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=f17cacd6-5f1e-4b19-986d-0019b0b697cb,segment=NetworkSegment(e86c45d4-b3d7-41e1-892c-83dec0fca686),segment_id=e86c45d4-b3d7-41e1-892c-83dec0fca686)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:22.851451 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': 'f17cacd6-5f1e-4b19-986d-0019b0b697cb', 'network_id': 'ebca9b29-55b2-47f1-bcfb-6bced6fdc050', 'port_id': 'f17cacd6-5f1e-4b19-986d-0019b0b697cb', 'mac_address': 'fa:16:3e:77:fa:8c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 403, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2c54f9a1-64d2-45bf-94c0-c7d4cd8d6225', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:55:22.854692 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:23.008311 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '43ed8d1a-ee0a-4df9-9df5-1c14a02f642c'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:55:23.013307 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6e3216ba-8d16-4e82-a448-849cd55bb178" -d '{"events": [{"server_uuid": "66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3", "name": "network-vif-plugged", "status": "completed", "tag": "43ed8d1a-ee0a-4df9-9df5-1c14a02f642c"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:55:23.013578 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc72066d-14e2-4215-afba-555175a00242 req-bec47d72-f479-48eb-a48c-a71ccb40f33f tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:23.022311 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cc72066d-14e2-4215-afba-555175a00242 req-bec47d72-f479-48eb-a48c-a71ccb40f33f tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 944 time: 0.0652337 Dec 20 05:55:23.037116 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c,segment=NetworkSegment(e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e),segment_id=e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:23.043154 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:23.063048 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f17cacd6-5f1e-4b19-986d-0019b0b697cb {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:55:23.069320 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:23.090999 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:55:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f3e5933-f10d-4c93-a6a9-ca005fc3a7d0 x-openstack-request-id: req-7f3e5933-f10d-4c93-a6a9-ca005fc3a7d0 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:55:23.092182 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3", "name": "network-vif-plugged", "status": "completed", "tag": "43ed8d1a-ee0a-4df9-9df5-1c14a02f642c", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:55:23.092663 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-7f3e5933-f10d-4c93-a6a9-ca005fc3a7d0 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:55:23.093290 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '43ed8d1a-ee0a-4df9-9df5-1c14a02f642c', 'code': 200} Dec 20 05:55:23.098516 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cc72066d-14e2-4215-afba-555175a00242 req-2f0e138c-0b06-41b4-a482-49c71d412956 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750463 Dec 20 05:55:23.165820 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port f17cacd6-5f1e-4b19-986d-0019b0b697cb, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=f17cacd6-5f1e-4b19-986d-0019b0b697cb,segment=NetworkSegment(e86c45d4-b3d7-41e1-892c-83dec0fca686),segment_id=e86c45d4-b3d7-41e1-892c-83dec0fca686)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:23.172033 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:23.193199 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:23.265193 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=f17cacd6-5f1e-4b19-986d-0019b0b697cb,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:23.368294 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-256248b7-22e8-44e8-8e85-e1bd0e5f8e70 req-385c28bc-8127-442c-8490-cfa648b0c7f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:23.369842 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-256248b7-22e8-44e8-8e85-e1bd0e5f8e70 req-385c28bc-8127-442c-8490-cfa648b0c7f6 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 1098 time: 0.0384560 Dec 20 05:55:23.431838 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-256248b7-22e8-44e8-8e85-e1bd0e5f8e70 req-06b97d0d-8118-499e-82f8-58585c2916c5 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0536075 Dec 20 05:55:23.503676 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db87a6ad-2020-4842-82b8-f61ad66ceb00 req-c67fbfa0-9d20-4ef1-90cb-e62ffa1e8ce1 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:23.507993 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-db87a6ad-2020-4842-82b8-f61ad66ceb00 req-c67fbfa0-9d20-4ef1-90cb-e62ffa1e8ce1 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 944 time: 0.0586154 Dec 20 05:55:23.554422 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-db87a6ad-2020-4842-82b8-f61ad66ceb00 req-c1f55208-141c-45cd-bb5b-6f02f0826ff5 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423353 Dec 20 05:55:23.582881 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['f17cacd6-5f1e-4b19-986d-0019b0b697cb'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:55:23.942197 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb9f82ca-f8f0-436b-b416-9eb54e3d9a8f req-8660cfd9-c081-49f5-ade2-572d4eccc869 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:23.943854 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cb9f82ca-f8f0-436b-b416-9eb54e3d9a8f req-8660cfd9-c081-49f5-ade2-572d4eccc869 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0536342 Dec 20 05:55:24.016350 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cb9f82ca-f8f0-436b-b416-9eb54e3d9a8f req-f9e535dc-8a8e-4807-ac55-c99c94115d81 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0632484 Dec 20 05:55:24.252148 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-389dbb2b-d9f7-46c9-b71a-88c1dc49e866 req-f386634c-fb9c-4a75-b835-767539651e4c tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:24.259983 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-389dbb2b-d9f7-46c9-b71a-88c1dc49e866 req-f386634c-fb9c-4a75-b835-767539651e4c tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0729737 Dec 20 05:55:24.317907 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-389dbb2b-d9f7-46c9-b71a-88c1dc49e866 req-3356c351-3c66-4c05-8ea5-e0f5561acfc7 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0569613 Dec 20 05:55:24.592557 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device f17cacd6-5f1e-4b19-986d-0019b0b697cb up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:55:24.658876 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port f17cacd6-5f1e-4b19-986d-0019b0b697cb completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 05:55:24.662792 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port f17cacd6-5f1e-4b19-986d-0019b0b697cb triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:24.663152 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:24.692019 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bac89dd-b125-4966-82fe-b40993bc7d7b req-b2211459-4f0c-43a3-babe-7f6b68a2d8d6 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:24.694093 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8bac89dd-b125-4966-82fe-b40993bc7d7b req-b2211459-4f0c-43a3-babe-7f6b68a2d8d6 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 944 time: 0.0619597 Dec 20 05:55:24.740315 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:24.743168 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8bac89dd-b125-4966-82fe-b40993bc7d7b req-8dca9385-85f4-4170-887d-eccefe10952a tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405121 Dec 20 05:55:24.776392 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port f17cacd6-5f1e-4b19-986d-0019b0b697cb, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=f17cacd6-5f1e-4b19-986d-0019b0b697cb,segment=NetworkSegment(e86c45d4-b3d7-41e1-892c-83dec0fca686),segment_id=e86c45d4-b3d7-41e1-892c-83dec0fca686)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:24.781008 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:24.835726 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=f17cacd6-5f1e-4b19-986d-0019b0b697cb,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:25.095491 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2f58997-0d62-4c82-b6dc-ccaf39db4ef9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f17cacd6-5f1e-4b19-986d-0019b0b697cb'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:55:25.097873 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-110a9341-b503-4814-adbd-7b49e0a0f48a" -d '{"events": [{"server_uuid": "e2f58997-0d62-4c82-b6dc-ccaf39db4ef9", "name": "network-vif-plugged", "status": "completed", "tag": "f17cacd6-5f1e-4b19-986d-0019b0b697cb"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:55:25.140237 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d668cd12-2c85-4b60-a60c-6c2f1e15ee7a req-48317238-684f-4624-a50a-d7b992f91791 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:25.142234 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d668cd12-2c85-4b60-a60c-6c2f1e15ee7a req-48317238-684f-4624-a50a-d7b992f91791 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0567470 Dec 20 05:55:25.142935 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:55:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-079d4a2d-59d2-457d-9df7-23a611135afa x-openstack-request-id: req-079d4a2d-59d2-457d-9df7-23a611135afa {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:55:25.143249 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e2f58997-0d62-4c82-b6dc-ccaf39db4ef9", "name": "network-vif-plugged", "status": "completed", "tag": "f17cacd6-5f1e-4b19-986d-0019b0b697cb", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:55:25.143535 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-079d4a2d-59d2-457d-9df7-23a611135afa {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:55:25.143944 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2f58997-0d62-4c82-b6dc-ccaf39db4ef9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f17cacd6-5f1e-4b19-986d-0019b0b697cb', 'code': 200} Dec 20 05:55:25.194408 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d668cd12-2c85-4b60-a60c-6c2f1e15ee7a req-70c2bd03-9dad-4819-bc10-76d4800514d4 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440829 Dec 20 05:55:25.442012 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ee0819a-02d7-4559-b8b1-07d93cff44e4 req-5168ec6a-e064-4488-a32f-ec1344cd5c18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:25.442012 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4ee0819a-02d7-4559-b8b1-07d93cff44e4 req-5168ec6a-e064-4488-a32f-ec1344cd5c18 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 1098 time: 0.0867405 Dec 20 05:55:25.464841 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ff8f20-d7d4-47be-bff9-74b3526ec368 req-6061cded-d569-4c6e-81dc-e968e7f8857e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:25.467134 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-67ff8f20-d7d4-47be-bff9-74b3526ec368 req-6061cded-d569-4c6e-81dc-e968e7f8857e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0677638 Dec 20 05:55:25.490175 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4ee0819a-02d7-4559-b8b1-07d93cff44e4 req-7e23fe13-1dda-4f24-9417-0dce513e3703 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407882 Dec 20 05:55:25.517798 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-67ff8f20-d7d4-47be-bff9-74b3526ec368 req-089d8461-c9bb-4adb-948c-181a6be96198 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442874 Dec 20 05:55:25.783654 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58074ee9-dc72-4e2b-9be3-9d6ace257522 req-364fbdd0-3783-4013-891b-1f516dbdaad5 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:25.785172 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58074ee9-dc72-4e2b-9be3-9d6ace257522 req-364fbdd0-3783-4013-891b-1f516dbdaad5 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0515099 Dec 20 05:55:25.842719 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58074ee9-dc72-4e2b-9be3-9d6ace257522 req-ccb39856-8a4c-4e06-ac97-7acf76d88d42 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497525 Dec 20 05:55:26.028978 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 45392) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:26.029665 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abe03304-7223-4921-850e-7491a827c653 req-627465e3-5083-400d-8370-9ac50b5a430e tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:26.032851 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-abe03304-7223-4921-850e-7491a827c653 req-627465e3-5083-400d-8370-9ac50b5a430e tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 945 time: 0.0592170 Dec 20 05:55:26.084644 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-abe03304-7223-4921-850e-7491a827c653 req-db0cc744-1294-469d-9b59-1a0ae0d58992 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446570 Dec 20 05:55:26.172341 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-a6f61956-8847-4f81-8ec7-e98ae6fca7dc admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=07a060e12902490eadd093437976e4d4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1399102 Dec 20 05:55:26.172572 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 45396) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:26.224583 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-72ec1624-0b1e-426a-8891-408175db54b2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:26.249912 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-72ec1624-0b1e-426a-8891-408175db54b2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:26.320004 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-72ec1624-0b1e-426a-8891-408175db54b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:26.322979 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-72ec1624-0b1e-426a-8891-408175db54b2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:26.324509 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-72ec1624-0b1e-426a-8891-408175db54b2 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/d98b6c59-460b-46cb-86b0-929b673ba2ca HTTP/1.1" status: 204 len: 168 time: 0.1510451 Dec 20 05:55:26.330295 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ca1482-1252-486f-b115-9d5f6de6c399 req-7076e6e3-9296-4e4b-ae99-c71417e3f260 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:26.331971 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-54ca1482-1252-486f-b115-9d5f6de6c399 req-7076e6e3-9296-4e4b-ae99-c71417e3f260 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0662973 Dec 20 05:55:26.339043 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72ec1624-0b1e-426a-8891-408175db54b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d98b6c59-460b-46cb-86b0-929b673ba2ca,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:26.391967 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-54ca1482-1252-486f-b115-9d5f6de6c399 req-23189416-6568-4d6a-ae7b-dfac99758dc7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0511818 Dec 20 05:55:26.959981 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51d81aaf-e8bb-4f14-b286-f8e89ee2e991 req-dd59ab20-8207-45b7-b1f5-2bbfebbf26d9 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:26.961429 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-51d81aaf-e8bb-4f14-b286-f8e89ee2e991 req-dd59ab20-8207-45b7-b1f5-2bbfebbf26d9 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0480094 Dec 20 05:55:27.009684 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-51d81aaf-e8bb-4f14-b286-f8e89ee2e991 req-50f6a196-1552-4893-a43d-a72b85bd72bf tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424464 Dec 20 05:55:27.200006 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dc3db6d-dacf-4034-8911-21e9adb3be6d req-cf7a0f6a-5cd3-416d-a71c-14bef4fdf85b tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:27.201357 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7dc3db6d-dacf-4034-8911-21e9adb3be6d req-cf7a0f6a-5cd3-416d-a71c-14bef4fdf85b tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 945 time: 0.0479696 Dec 20 05:55:27.247605 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7dc3db6d-dacf-4034-8911-21e9adb3be6d req-6569b1d0-e57d-4a83-9e6d-124ec9a4afdb tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400033 Dec 20 05:55:27.506603 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdd62681-83ed-4727-aae8-bb15378e7659 req-66ba6929-7f69-4fc6-b4b4-69e97e18b2a9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:27.508088 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bdd62681-83ed-4727-aae8-bb15378e7659 req-66ba6929-7f69-4fc6-b4b4-69e97e18b2a9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0481765 Dec 20 05:55:27.553688 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bdd62681-83ed-4727-aae8-bb15378e7659 req-023bd9ec-e5e0-4c6b-8ee9-7370c92a65ae tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396564 Dec 20 05:55:28.125197 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-981e2faf-151c-4484-9ce1-baa90e80b0bc req-fc5abf57-fbef-44ee-8ab9-0007f2d53b5a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:28.126757 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-981e2faf-151c-4484-9ce1-baa90e80b0bc req-fc5abf57-fbef-44ee-8ab9-0007f2d53b5a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0510669 Dec 20 05:55:28.173643 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-981e2faf-151c-4484-9ce1-baa90e80b0bc req-e0006a13-4e28-4659-8cfb-2931848714eb tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410171 Dec 20 05:55:28.358948 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb02e901-5d17-4a84-9d70-b2f903c77859 req-9b1c57cc-6018-4dae-b569-9476fcb84ed7 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:28.360430 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cb02e901-5d17-4a84-9d70-b2f903c77859 req-9b1c57cc-6018-4dae-b569-9476fcb84ed7 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 945 time: 0.0480044 Dec 20 05:55:28.410211 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cb02e901-5d17-4a84-9d70-b2f903c77859 req-ce7168ce-25c5-4ada-a4af-e5eecda9213f tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438488 Dec 20 05:55:28.668408 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef81d52-7366-4980-8a93-35b25da921b5 req-7a59ecc5-0677-4be0-94a0-1f315a092c63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:28.670038 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6ef81d52-7366-4980-8a93-35b25da921b5 req-7a59ecc5-0677-4be0-94a0-1f315a092c63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0494740 Dec 20 05:55:28.697460 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-decf4700-55cb-4124-aab2-19dbc26fe689 req-40f96cf3-b8ee-4131-9465-993b9a2e6b24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:28.699447 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-decf4700-55cb-4124-aab2-19dbc26fe689 req-40f96cf3-b8ee-4131-9465-993b9a2e6b24 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a2e9de0d64e642f08bf90d402e77baa3&device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 1098 time: 0.0437257 Dec 20 05:55:28.720104 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6ef81d52-7366-4980-8a93-35b25da921b5 req-cf107d94-34bb-42cb-bca4-990ea3662758 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436044 Dec 20 05:55:29.028370 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-decf4700-55cb-4124-aab2-19dbc26fe689 req-124caeab-c11a-44ce-a69a-a3e91855269d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:29.029785 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-decf4700-55cb-4124-aab2-19dbc26fe689 req-124caeab-c11a-44ce-a69a-a3e91855269d service neutron] 10.222.0.54 "GET /v2.0/networks?id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a HTTP/1.1" status: 200 len: 920 time: 0.3218503 Dec 20 05:55:29.075471 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-decf4700-55cb-4124-aab2-19dbc26fe689 req-d5e6ef46-aa1f-4c1d-97cc-4a4ac208f8c0 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c HTTP/1.1" status: 200 len: 217 time: 0.0338316 Dec 20 05:55:29.122733 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-decf4700-55cb-4124-aab2-19dbc26fe689 req-36a59f5e-e6ae-419f-9e7c-b07ccbd53a98 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:29.124147 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-decf4700-55cb-4124-aab2-19dbc26fe689 req-36a59f5e-e6ae-419f-9e7c-b07ccbd53a98 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=e1658c3d-4c2e-4687-a529-637456d3a81c HTTP/1.1" status: 200 len: 859 time: 0.0412958 Dec 20 05:55:29.158998 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-decf4700-55cb-4124-aab2-19dbc26fe689 req-f25e49a5-4a23-4ecb-b763-95dfd2b62033 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0256615 Dec 20 05:55:29.251781 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-decf4700-55cb-4124-aab2-19dbc26fe689 req-15905e61-33b0-40ea-affb-5039147bc985 service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842433 Dec 20 05:55:29.285558 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f101572-8a81-4b93-bebc-bed7430645f5 req-97a67b4b-7131-4aba-a802-822891290f51 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:29.286956 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3f101572-8a81-4b93-bebc-bed7430645f5 req-97a67b4b-7131-4aba-a802-822891290f51 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0476861 Dec 20 05:55:29.333264 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3f101572-8a81-4b93-bebc-bed7430645f5 req-692cab24-85f4-46b1-ac20-0eaeea011e0a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401189 Dec 20 05:55:29.521850 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ca1c0c-d763-4f4d-b756-d64a9b18622b req-5628cd5c-2fc1-485d-8cce-b0cbe624d1e6 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:29.523302 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-44ca1c0c-d763-4f4d-b756-d64a9b18622b req-5628cd5c-2fc1-485d-8cce-b0cbe624d1e6 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 945 time: 0.0468020 Dec 20 05:55:29.569970 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-44ca1c0c-d763-4f4d-b756-d64a9b18622b req-549fd693-da56-4fdf-a188-d1af313d2967 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407887 Dec 20 05:55:29.845004 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e7d02f6-36db-4979-9c3d-0c305a4aa100 req-d6c96194-d931-4d1c-8589-1ef6bb33a6b6 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:29.846487 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9e7d02f6-36db-4979-9c3d-0c305a4aa100 req-d6c96194-d931-4d1c-8589-1ef6bb33a6b6 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0590270 Dec 20 05:55:29.900414 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9e7d02f6-36db-4979-9c3d-0c305a4aa100 req-53d32058-7948-4335-a4d6-be9c16d5a993 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478075 Dec 20 05:55:30.385222 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-decf4700-55cb-4124-aab2-19dbc26fe689 req-d1ddc49c-4bec-4dcf-ae36-7fc250659108 service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863388 Dec 20 05:55:30.443068 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d619c844-3f78-49a3-bb58-912528d3afcf req-69dec769-ddaf-49b2-8814-93e0f127dca9 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:30.444543 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d619c844-3f78-49a3-bb58-912528d3afcf req-69dec769-ddaf-49b2-8814-93e0f127dca9 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0471334 Dec 20 05:55:30.491319 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d619c844-3f78-49a3-bb58-912528d3afcf req-0cebf984-2e34-455d-acfb-6f913b785b03 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405676 Dec 20 05:55:30.687395 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00f24f6a-5549-4ce8-a644-70f9069ac335 req-130316ad-b0bd-4dfc-8f34-35e59082c7f2 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:30.688787 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-00f24f6a-5549-4ce8-a644-70f9069ac335 req-130316ad-b0bd-4dfc-8f34-35e59082c7f2 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 945 time: 0.0504520 Dec 20 05:55:30.735660 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-00f24f6a-5549-4ce8-a644-70f9069ac335 req-24bd1a27-afcc-45b7-8e0b-08373e7d4520 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409482 Dec 20 05:55:31.019522 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce33b968-5716-44e0-a16b-7a1fa44641f7 req-a82d4b22-62cf-4f69-be92-fc004dd302b0 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:31.020993 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ce33b968-5716-44e0-a16b-7a1fa44641f7 req-a82d4b22-62cf-4f69-be92-fc004dd302b0 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0481896 Dec 20 05:55:31.067427 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ce33b968-5716-44e0-a16b-7a1fa44641f7 req-9178bc63-4313-4003-9310-2dabf6d4d16d tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396512 Dec 20 05:55:31.604022 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba74e7e-99a8-49b9-a33c-15dc1cab960a req-d492f981-8f98-4e4b-b8aa-5e28fd3a8480 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:31.605525 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4ba74e7e-99a8-49b9-a33c-15dc1cab960a req-d492f981-8f98-4e4b-b8aa-5e28fd3a8480 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0486317 Dec 20 05:55:31.654192 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4ba74e7e-99a8-49b9-a33c-15dc1cab960a req-8ef47e28-6d9d-4673-b920-a0c8f66b4329 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428801 Dec 20 05:55:31.712223 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-bcac6f00-ab79-4ea9-b960-4b5aa6c95c85 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:31.848067 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea6cfda2-f922-4b12-bb94-e8e36e62c08a req-52fe4989-092b-4982-a847-b60869b6b66a tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:31.849514 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ea6cfda2-f922-4b12-bb94-e8e36e62c08a req-52fe4989-092b-4982-a847-b60869b6b66a tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 945 time: 0.0486917 Dec 20 05:55:31.900697 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ea6cfda2-f922-4b12-bb94-e8e36e62c08a req-df321c83-1dcd-4d0d-a001-86d814b1a200 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447679 Dec 20 05:55:32.180263 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfa1f370-ac07-41ef-8f1b-2ffc79a0186e req-eeef76ac-1f25-4f1a-8d61-8c313b874fe0 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:32.181726 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bfa1f370-ac07-41ef-8f1b-2ffc79a0186e req-eeef76ac-1f25-4f1a-8d61-8c313b874fe0 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0484493 Dec 20 05:55:32.230620 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bfa1f370-ac07-41ef-8f1b-2ffc79a0186e req-bc5d2d59-09f3-46c8-b6a9-636c64aa16e1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423295 Dec 20 05:55:32.769787 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a31c584-a91d-4ea1-af7d-700c4492c512 req-0acae086-0bea-45bd-8761-b8700789ca6e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:32.771334 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9a31c584-a91d-4ea1-af7d-700c4492c512 req-0acae086-0bea-45bd-8761-b8700789ca6e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0520325 Dec 20 05:55:32.820222 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9a31c584-a91d-4ea1-af7d-700c4492c512 req-1daefd00-a5e5-433c-bfb9-f8e7cfd6fa68 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415618 Dec 20 05:55:33.023431 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f3fa31c-ceb4-405a-a69e-d0a499d8b88c req-ba39c782-02a2-449f-beda-cb39b6a00345 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:33.024945 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3f3fa31c-ceb4-405a-a69e-d0a499d8b88c req-ba39c782-02a2-449f-beda-cb39b6a00345 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 945 time: 0.0496268 Dec 20 05:55:33.071911 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3f3fa31c-ceb4-405a-a69e-d0a499d8b88c req-8c57668e-177c-424f-908f-b81dc63482d7 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410171 Dec 20 05:55:33.351160 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6684d215-7ade-40f7-a2ee-73c4d5314e9b req-f3ecfd8f-22f6-4c03-8195-e51f6d7c4b0c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:33.352654 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6684d215-7ade-40f7-a2ee-73c4d5314e9b req-f3ecfd8f-22f6-4c03-8195-e51f6d7c4b0c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0484073 Dec 20 05:55:33.403963 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6684d215-7ade-40f7-a2ee-73c4d5314e9b req-20867d68-6075-4027-8f4e-1f000943ec6e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448263 Dec 20 05:55:33.949931 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25651eb2-5fa1-46e2-90e0-ee0089602724 req-4d4a5bfd-0552-457c-8e29-f9cf67d3e6fa tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:33.951410 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-25651eb2-5fa1-46e2-90e0-ee0089602724 req-4d4a5bfd-0552-457c-8e29-f9cf67d3e6fa tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0498896 Dec 20 05:55:33.998293 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-25651eb2-5fa1-46e2-90e0-ee0089602724 req-aa831892-ae5c-45c9-a2a8-7a3ffe4b81d2 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400300 Dec 20 05:55:34.150036 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-0d849656-8384-463e-b928-c36ea9c72882 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:34.377423 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-763c5e67-b59c-4b99-9b52-7d7a99807e9b req-23d9d144-39fc-4057-b6e2-7e9711b117e0 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:34.378873 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-763c5e67-b59c-4b99-9b52-7d7a99807e9b req-23d9d144-39fc-4057-b6e2-7e9711b117e0 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 945 time: 0.0474150 Dec 20 05:55:34.425034 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-763c5e67-b59c-4b99-9b52-7d7a99807e9b req-72492ebe-774b-491f-9082-b79249f90e1d tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404031 Dec 20 05:55:34.526191 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a913abd-fe2f-4a40-835a-c932f33cceb0 req-8b28e6db-108a-466e-a8bd-958276f4cb85 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:34.527688 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2a913abd-fe2f-4a40-835a-c932f33cceb0 req-8b28e6db-108a-466e-a8bd-958276f4cb85 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0512125 Dec 20 05:55:34.572886 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2a913abd-fe2f-4a40-835a-c932f33cceb0 req-745886a9-da59-4045-b63a-ff125d09be61 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392582 Dec 20 05:55:34.970452 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:35.116129 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d23ae925-e107-4fb4-8aef-2ee721fff420 req-4edde88d-b604-4130-9906-5ef5bdcf3edf tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:35.117594 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d23ae925-e107-4fb4-8aef-2ee721fff420 req-4edde88d-b604-4130-9906-5ef5bdcf3edf tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0488601 Dec 20 05:55:35.167165 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d23ae925-e107-4fb4-8aef-2ee721fff420 req-d8c598ec-94b2-45bd-b314-348000e6eb5a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434132 Dec 20 05:55:35.547474 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d4a88f1-0892-4027-9628-bcd0e11e2580 req-17b1ed04-8299-4cf9-a74f-65e21e86719d tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:35.548890 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3d4a88f1-0892-4027-9628-bcd0e11e2580 req-17b1ed04-8299-4cf9-a74f-65e21e86719d tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 945 time: 0.0515726 Dec 20 05:55:35.596632 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3d4a88f1-0892-4027-9628-bcd0e11e2580 req-3dd30ede-bbeb-48f6-86db-ba35b381d0a8 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414400 Dec 20 05:55:35.658232 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 45614) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:35.690169 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38e0997d-09e8-4e84-a78c-3e0cb4d2dd0f req-8b3c973d-1281-43a3-a346-c68a080327fd tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:35.691919 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-38e0997d-09e8-4e84-a78c-3e0cb4d2dd0f req-8b3c973d-1281-43a3-a346-c68a080327fd tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0489798 Dec 20 05:55:35.740720 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-38e0997d-09e8-4e84-a78c-3e0cb4d2dd0f req-113b39ae-6c8e-4671-bbfb-2baf515a8aca tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422173 Dec 20 05:55:35.781654 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fa8a0cb0-3b95-4e7d-a669-390ab626e4aa admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:35.859975 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fa8a0cb0-3b95-4e7d-a669-390ab626e4aa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:35.863867 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fa8a0cb0-3b95-4e7d-a669-390ab626e4aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:35.902257 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-fa8a0cb0-3b95-4e7d-a669-390ab626e4aa admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=9f70938b2a3d4cee9cae756097853b21&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2422311 Dec 20 05:55:35.903347 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa8a0cb0-3b95-4e7d-a669-390ab626e4aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a27bf24-cd0b-4c5f-bf5e-285540b6b8a9,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:35.904910 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 45624) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:35.956653 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-41e8abca-f84c-41cd-b2b7-f2ee31336fc6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:35.980262 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-41e8abca-f84c-41cd-b2b7-f2ee31336fc6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:36.030625 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-41e8abca-f84c-41cd-b2b7-f2ee31336fc6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:36.033254 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-41e8abca-f84c-41cd-b2b7-f2ee31336fc6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:36.036959 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-41e8abca-f84c-41cd-b2b7-f2ee31336fc6 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/8a27bf24-cd0b-4c5f-bf5e-285540b6b8a9 HTTP/1.1" status: 204 len: 168 time: 0.1309352 Dec 20 05:55:36.045136 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41e8abca-f84c-41cd-b2b7-f2ee31336fc6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a27bf24-cd0b-4c5f-bf5e-285540b6b8a9,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:36.289009 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045c3961-1a02-4ce6-b688-ffba05d45ec2 req-40fe27ed-8d7b-490e-8053-71f338e1d90b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:36.290484 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-045c3961-1a02-4ce6-b688-ffba05d45ec2 req-40fe27ed-8d7b-490e-8053-71f338e1d90b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0537217 Dec 20 05:55:36.338355 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-045c3961-1a02-4ce6-b688-ffba05d45ec2 req-2df70cba-b899-4c18-b7be-9f42becd8d60 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416527 Dec 20 05:55:36.361691 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-012d778a-1333-4a61-9ed5-dcd7e4c65e50 req-69b1f1e7-b19a-4e60-952f-237e3b0a32a1 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:36.363604 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-012d778a-1333-4a61-9ed5-dcd7e4c65e50 req-69b1f1e7-b19a-4e60-952f-237e3b0a32a1 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.54 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 945 time: 0.0544953 Dec 20 05:55:36.459800 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:36.469161 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-012d778a-1333-4a61-9ed5-dcd7e4c65e50 req-5a14f5ac-6f3b-4f9e-be68-dbe469b097fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Deleting port f17cacd6-5f1e-4b19-986d-0019b0b697cb {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:55:36.469459 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-012d778a-1333-4a61-9ed5-dcd7e4c65e50 req-5a14f5ac-6f3b-4f9e-be68-dbe469b097fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:36.566177 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-012d778a-1333-4a61-9ed5-dcd7e4c65e50 req-5a14f5ac-6f3b-4f9e-be68-dbe469b097fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] For port f17cacd6-5f1e-4b19-986d-0019b0b697cb, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=f17cacd6-5f1e-4b19-986d-0019b0b697cb,segment=NetworkSegment(e86c45d4-b3d7-41e1-892c-83dec0fca686),segment_id=e86c45d4-b3d7-41e1-892c-83dec0fca686)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:36.566570 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-012d778a-1333-4a61-9ed5-dcd7e4c65e50 req-5a14f5ac-6f3b-4f9e-be68-dbe469b097fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:36.584190 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-012d778a-1333-4a61-9ed5-dcd7e4c65e50 req-5a14f5ac-6f3b-4f9e-be68-dbe469b097fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Calling delete_port for f17cacd6-5f1e-4b19-986d-0019b0b697cb owned by compute:nova {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:55:36.715544 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-012d778a-1333-4a61-9ed5-dcd7e4c65e50 req-5a14f5ac-6f3b-4f9e-be68-dbe469b097fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:36.721322 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc4af616-359c-4216-b267-566315f5a23a req-4e2e2d27-d518-4e67-9a1c-758f88b2f0da tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:36.723048 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bc4af616-359c-4216-b267-566315f5a23a req-4e2e2d27-d518-4e67-9a1c-758f88b2f0da tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=e2f58997-0d62-4c82-b6dc-ccaf39db4ef9 HTTP/1.1" status: 200 len: 945 time: 0.0514972 Dec 20 05:55:36.758715 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['f17cacd6-5f1e-4b19-986d-0019b0b697cb'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:55:36.759696 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a14f5ac-6f3b-4f9e-be68-dbe469b097fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Pushing event deleted for resources: {'Port': ['ID=f17cacd6-5f1e-4b19-986d-0019b0b697cb,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:36.800992 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-012d778a-1333-4a61-9ed5-dcd7e4c65e50 req-5a14f5ac-6f3b-4f9e-be68-dbe469b097fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] No DVR routers for this DVR port f17cacd6-5f1e-4b19-986d-0019b0b697cb on host hv-cinder-82227 {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 05:55:36.804712 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-012d778a-1333-4a61-9ed5-dcd7e4c65e50 req-5a14f5ac-6f3b-4f9e-be68-dbe469b097fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:36.814903 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-012d778a-1333-4a61-9ed5-dcd7e4c65e50 req-5a14f5ac-6f3b-4f9e-be68-dbe469b097fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.54 "DELETE /v2.0/ports/f17cacd6-5f1e-4b19-986d-0019b0b697cb HTTP/1.1" status: 204 len: 173 time: 0.4379926 Dec 20 05:55:36.814903 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2f58997-0d62-4c82-b6dc-ccaf39db4ef9', 'name': 'network-vif-deleted', 'tag': 'f17cacd6-5f1e-4b19-986d-0019b0b697cb'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:55:36.814903 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f23bf429-9edf-447e-8df7-dc26459c224e" -d '{"events": [{"server_uuid": "e2f58997-0d62-4c82-b6dc-ccaf39db4ef9", "name": "network-vif-deleted", "tag": "f17cacd6-5f1e-4b19-986d-0019b0b697cb"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:55:36.816077 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bc4af616-359c-4216-b267-566315f5a23a req-38ad04bd-1393-4275-b557-f7c143692560 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0867355 Dec 20 05:55:36.875871 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:55:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a85e2812-24b9-4cb5-a99d-469e20b59159 x-openstack-request-id: req-a85e2812-24b9-4cb5-a99d-469e20b59159 {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:55:36.876252 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e2f58997-0d62-4c82-b6dc-ccaf39db4ef9", "name": "network-vif-deleted", "tag": "f17cacd6-5f1e-4b19-986d-0019b0b697cb", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:55:36.876577 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-a85e2812-24b9-4cb5-a99d-469e20b59159 {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:55:36.877114 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2f58997-0d62-4c82-b6dc-ccaf39db4ef9', 'name': 'network-vif-deleted', 'tag': 'f17cacd6-5f1e-4b19-986d-0019b0b697cb', 'status': 'completed', 'code': 200} Dec 20 05:55:36.905621 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e083b3-e860-4ead-a0c1-a02269bbe671 req-3d5df7fc-977e-4b94-aa87-5c96b3672a91 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:36.907385 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-70e083b3-e860-4ead-a0c1-a02269bbe671 req-3d5df7fc-977e-4b94-aa87-5c96b3672a91 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0659418 Dec 20 05:55:36.957058 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-70e083b3-e860-4ead-a0c1-a02269bbe671 req-e8083ad3-8f37-4c1a-9858-57cc3f172412 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429065 Dec 20 05:55:37.308638 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:37.506928 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34a138f-dcc8-47b3-be35-978911f5ad46 req-0d9a9951-3209-4e77-a287-d10a30f130ac tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:37.509308 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e34a138f-dcc8-47b3-be35-978911f5ad46 req-0d9a9951-3209-4e77-a287-d10a30f130ac tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0835941 Dec 20 05:55:37.559650 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e34a138f-dcc8-47b3-be35-978911f5ad46 req-943927e9-a98f-4d65-a94c-4eb75d5c0535 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436690 Dec 20 05:55:37.580731 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:38.139280 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7054e41d-7b98-4b62-95b8-1dedfd851da5 req-d14e28ac-241d-42b7-8ec7-ef8696fd2117 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:38.140783 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7054e41d-7b98-4b62-95b8-1dedfd851da5 req-d14e28ac-241d-42b7-8ec7-ef8696fd2117 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.1163001 Dec 20 05:55:38.188965 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-3474975d-49da-400f-b056-1f43c2c59888 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:38.190390 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-3474975d-49da-400f-b056-1f43c2c59888 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/networks?id=ebca9b29-55b2-47f1-bcfb-6bced6fdc050 HTTP/1.1" status: 200 len: 809 time: 0.1568785 Dec 20 05:55:38.218794 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7054e41d-7b98-4b62-95b8-1dedfd851da5 req-93f3129a-6b96-473e-8582-89d5571ada72 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0709493 Dec 20 05:55:38.220156 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-11a3cbf6-2c32-45ca-a1b4-6272c90f701a tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/quotas/c55e4805e4ec461e98ab84a95a8755d7 HTTP/1.1" status: 200 len: 375 time: 0.0222473 Dec 20 05:55:38.254691 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-9d2085d0-723c-4303-80a4-6c3c4bb2e0b4 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=c55e4805e4ec461e98ab84a95a8755d7&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0287745 Dec 20 05:55:38.343279 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-96b62d3c-2d3f-409c-814f-388bd0eb9c3d service neutron] 10.222.0.46 "GET /v2.0/networks/ebca9b29-55b2-47f1-bcfb-6bced6fdc050?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810668 Dec 20 05:55:38.444329 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e4ec9b58-f683-41a5-ac43-cbb8a21c3ba9 service neutron] 10.222.0.46 "GET /v2.0/networks/ebca9b29-55b2-47f1-bcfb-6bced6fdc050?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0950730 Dec 20 05:55:38.637462 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4df7b542-9500-4fa6-97c6-6d17ce906f88 req-d0694dee-e16c-4a07-b7c7-6e5d934bdf9e tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 210 time: 0.0497181 Dec 20 05:55:38.737727 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-391aa5db-5113-4db2-b2e5-58189b84c386 req-954f4404-3632-415e-991a-ca9c994e6d92 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:38.739192 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-391aa5db-5113-4db2-b2e5-58189b84c386 req-954f4404-3632-415e-991a-ca9c994e6d92 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0501022 Dec 20 05:55:38.788058 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-391aa5db-5113-4db2-b2e5-58189b84c386 req-3022d33f-7c54-438a-a00d-0118fe9bfd1f tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412478 Dec 20 05:55:39.331596 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145d0674-2490-4904-8bf8-f42d4ff8f597 req-7a8692b6-999b-4f00-a8d0-3d00ca528f85 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:39.333038 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-145d0674-2490-4904-8bf8-f42d4ff8f597 req-7a8692b6-999b-4f00-a8d0-3d00ca528f85 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0479090 Dec 20 05:55:39.381378 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-145d0674-2490-4904-8bf8-f42d4ff8f597 req-7082484d-0cae-4e96-ace9-94fb50649454 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425203 Dec 20 05:55:39.751639 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5303a6f8-2e6e-42ea-902a-43ba0b9ca2d9 req-e25188aa-f59b-4d73-948d-3a8cfc1c49db tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 210 time: 0.0255072 Dec 20 05:55:40.042769 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce63a3e-1a81-487d-aa70-4f1bb2860d90 req-3f570515-4742-404a-84e1-8038a4f91687 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:40.044304 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7ce63a3e-1a81-487d-aa70-4f1bb2860d90 req-3f570515-4742-404a-84e1-8038a4f91687 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0471308 Dec 20 05:55:40.089841 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7ce63a3e-1a81-487d-aa70-4f1bb2860d90 req-30b94fe1-ef9f-45ea-8a4f-2e554cc17cf2 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397284 Dec 20 05:55:40.491882 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a0fcca8-746b-4b12-8aad-ad3a95b7c760 req-84ac1be9-4cec-4a5b-a49d-36c085a65b7e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:40.493299 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7a0fcca8-746b-4b12-8aad-ad3a95b7c760 req-84ac1be9-4cec-4a5b-a49d-36c085a65b7e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0461938 Dec 20 05:55:40.540658 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7a0fcca8-746b-4b12-8aad-ad3a95b7c760 req-391c39bc-062c-49c9-86bc-a1c398aeb858 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410469 Dec 20 05:55:40.839896 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9a42f894-5c9d-4038-a329-5ba08f5c5dcb req-f830d2ea-dcd9-4e58-a466-f0b67e69ceba tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 210 time: 0.0248065 Dec 20 05:55:40.936584 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device f17cacd6-5f1e-4b19-986d-0019b0b697cb no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:55:40.961417 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: f17cacd6-5f1e-4b19-986d-0019b0b697cb {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:55:40.961766 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device f17cacd6-5f1e-4b19-986d-0019b0b697cb not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:55:41.158010 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b4e3cd-befe-4b90-b310-39f50418149d req-afc09d79-c0d2-42cd-9d55-5911bd35cbed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:41.159667 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-06b4e3cd-befe-4b90-b310-39f50418149d req-afc09d79-c0d2-42cd-9d55-5911bd35cbed service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1898b7c1b3dc4523b09a97486622c67e&device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 1098 time: 0.0420604 Dec 20 05:55:41.215177 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-083ce584-6a93-4665-bfc1-6d106a20efe2 req-a31e3296-3f36-4cf0-ab08-063d9a8d9792 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:41.216722 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-083ce584-6a93-4665-bfc1-6d106a20efe2 req-a31e3296-3f36-4cf0-ab08-063d9a8d9792 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0567911 Dec 20 05:55:41.265757 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-083ce584-6a93-4665-bfc1-6d106a20efe2 req-a4358c0e-f109-4d3e-a415-09457cf2b6e9 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426891 Dec 20 05:55:41.287028 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b4e3cd-befe-4b90-b310-39f50418149d req-09b02eb3-c34a-4146-a871-6e50c7dfe59e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:41.288512 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-06b4e3cd-befe-4b90-b310-39f50418149d req-09b02eb3-c34a-4146-a871-6e50c7dfe59e service neutron] 10.222.0.54 "GET /v2.0/networks?id=6924a88e-10c1-4073-a41c-88aad14ebd0f HTTP/1.1" status: 200 len: 912 time: 0.0981593 Dec 20 05:55:41.390382 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-06b4e3cd-befe-4b90-b310-39f50418149d req-fffd1e3d-0264-4137-b361-25c25ec41eab service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=abed4d23-da46-4f59-9f36-c9fc12fcb192 HTTP/1.1" status: 200 len: 1001 time: 0.0869761 Dec 20 05:55:41.443129 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b4e3cd-befe-4b90-b310-39f50418149d req-3b8bc8ce-77e8-42e7-a00b-416313771c48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:41.444669 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-06b4e3cd-befe-4b90-b310-39f50418149d req-3b8bc8ce-77e8-42e7-a00b-416313771c48 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ffb588f9-2ffb-4921-8a76-be5179c2fbed HTTP/1.1" status: 200 len: 850 time: 0.0466661 Dec 20 05:55:41.500914 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b4e3cd-befe-4b90-b310-39f50418149d req-97bf85ae-8340-46f6-ab93-cc1d26555b27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:41.502338 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-06b4e3cd-befe-4b90-b310-39f50418149d req-97bf85ae-8340-46f6-ab93-cc1d26555b27 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6924a88e-10c1-4073-a41c-88aad14ebd0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0489323 Dec 20 05:55:41.595385 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-06b4e3cd-befe-4b90-b310-39f50418149d req-a2b99880-67f8-44ad-a4dd-d6990d1610d6 service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842373 Dec 20 05:55:41.761794 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-06b4e3cd-befe-4b90-b310-39f50418149d req-61963c1a-a72b-4c7d-9840-f416dfa7e007 service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1573792 Dec 20 05:55:41.972879 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39994d17-e27a-4950-91f6-9cbb9ef4f713 req-d1b02ea1-6a5d-490b-9bf6-312eb3ee195c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:41.974368 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-39994d17-e27a-4950-91f6-9cbb9ef4f713 req-d1b02ea1-6a5d-490b-9bf6-312eb3ee195c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.3342054 Dec 20 05:55:42.038889 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7fab9cdb-f4fc-449f-b64f-feaf04535fac req-dffc2f41-5c38-4354-b355-e110496a45a9 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 210 time: 0.0635536 Dec 20 05:55:42.102492 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-f89c57b6-e8a3-4b29-9ace-6a6268b33c54 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:42.104148 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-f89c57b6-e8a3-4b29-9ace-6a6268b33c54 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.54 "GET /v2.0/networks?id=ebca9b29-55b2-47f1-bcfb-6bced6fdc050 HTTP/1.1" status: 200 len: 809 time: 0.4151778 Dec 20 05:55:42.107950 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-39994d17-e27a-4950-91f6-9cbb9ef4f713 req-27801ba6-f719-4d9f-b542-f800d3d73e35 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1208987 Dec 20 05:55:42.138762 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Request body: {'port': {'device_id': 'c13f9a32-2218-44b3-9e80-d74fe7492eaf', 'network_id': 'ebca9b29-55b2-47f1-bcfb-6bced6fdc050', 'admin_state_up': True, 'tenant_id': 'c55e4805e4ec461e98ab84a95a8755d7'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:42.291081 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Made reservation on behalf of c55e4805e4ec461e98ab84a95a8755d7 for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:55:42.295004 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:42.437175 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7dde282-7e9e-4249-95fb-eec830456adc req-7f5b6bcf-14bb-4fb7-a09d-7728e1dec48b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:42.438670 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c7dde282-7e9e-4249-95fb-eec830456adc req-7f5b6bcf-14bb-4fb7-a09d-7728e1dec48b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1898b7c1b3dc4523b09a97486622c67e&device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 1098 time: 0.0470128 Dec 20 05:55:42.439784 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-872bad41-dacb-4b7d-9d76-af2b07db59c3 req-095122e0-f02c-4b47-9772-9557c3373264 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:42.441245 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-872bad41-dacb-4b7d-9d76-af2b07db59c3 req-095122e0-f02c-4b47-9772-9557c3373264 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.1430850 Dec 20 05:55:42.506881 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9fb8001-cd33-4146-b23c-e9805722c2be req-20ce7ddd-b9de-48c9-879c-95f844a5e0f5 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:42.509078 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c9fb8001-cd33-4146-b23c-e9805722c2be req-20ce7ddd-b9de-48c9-879c-95f844a5e0f5 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.1566648 Dec 20 05:55:42.537803 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7dde282-7e9e-4249-95fb-eec830456adc req-5321283c-e817-420d-827f-2fe672c10f7b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:42.539712 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c7dde282-7e9e-4249-95fb-eec830456adc req-5321283c-e817-420d-827f-2fe672c10f7b service neutron] 10.222.0.54 "GET /v2.0/networks?id=6924a88e-10c1-4073-a41c-88aad14ebd0f HTTP/1.1" status: 200 len: 912 time: 0.0911429 Dec 20 05:55:42.553467 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Allocated IP 172.20.0.8 (ebca9b29-55b2-47f1-bcfb-6bced6fdc050/2c54f9a1-64d2-45bf-94c0-c7d4cd8d6225/75f0ad55-bd12-4474-9eb7-d4482ab761b1) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:55:42.583835 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-872bad41-dacb-4b7d-9d76-af2b07db59c3 req-46767f4d-083e-4ffc-87e3-2ab47acb948b tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1362159 Dec 20 05:55:42.604767 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c9fb8001-cd33-4146-b23c-e9805722c2be req-d0a8900d-771b-48ca-9323-c2dc3eb2a5eb tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0866315 Dec 20 05:55:42.637150 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c7dde282-7e9e-4249-95fb-eec830456adc req-4945a891-baf4-4186-897b-828492f1dd2a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=abed4d23-da46-4f59-9f36-c9fc12fcb192 HTTP/1.1" status: 200 len: 1001 time: 0.0694201 Dec 20 05:55:42.692517 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7dde282-7e9e-4249-95fb-eec830456adc req-93c84e16-39b5-408f-97cc-0a6b5f947898 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:42.693972 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c7dde282-7e9e-4249-95fb-eec830456adc req-93c84e16-39b5-408f-97cc-0a6b5f947898 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ffb588f9-2ffb-4921-8a76-be5179c2fbed HTTP/1.1" status: 200 len: 850 time: 0.0465267 Dec 20 05:55:42.738598 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:42.750671 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7dde282-7e9e-4249-95fb-eec830456adc req-a5334784-1931-4a6c-a6bd-421031c5d900 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:42.752221 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c7dde282-7e9e-4249-95fb-eec830456adc req-a5334784-1931-4a6c-a6bd-421031c5d900 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6924a88e-10c1-4073-a41c-88aad14ebd0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0461106 Dec 20 05:55:42.780618 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:42.824152 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Network ebca9b29-55b2-47f1-bcfb-6bced6fdc050 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:55:42.827046 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:55:42.830930 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:55:42.837264 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Pushing event updated for resources: {'Port': ['ID=75f0ad55-bd12-4474-9eb7-d4482ab761b1,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:42.854372 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c7dde282-7e9e-4249-95fb-eec830456adc req-e1361dd9-bfd2-4057-b485-5eb7bddad561 service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0936236 Dec 20 05:55:42.865134 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:42.865483 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:42.865829 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:42.866157 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:42.866493 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:42.866822 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:42.867147 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:42.867467 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:42.867816 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:42.868139 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:42.868459 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:42.868777 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:42.869095 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:42.891686 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:42.892293 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:42.907385 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-64359236-96dc-40fc-9f3c-b8c932f61932 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7726011 Dec 20 05:55:42.933769 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Request body: {'port': {'device_id': 'c13f9a32-2218-44b3-9e80-d74fe7492eaf', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:42.960364 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c7dde282-7e9e-4249-95fb-eec830456adc req-94500371-9a2e-4f44-b7e1-490b880f7357 service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0988767 Dec 20 05:55:42.997216 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:43.211281 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-672de359-e055-4e83-8327-22edc6d28270 req-8e5a36df-79ad-4b1f-950e-ceaff1afde18 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:43.212792 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-672de359-e055-4e83-8327-22edc6d28270 req-8e5a36df-79ad-4b1f-950e-ceaff1afde18 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 931 time: 0.1010270 Dec 20 05:55:43.322017 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-672de359-e055-4e83-8327-22edc6d28270 req-44cd62a9-5241-4d41-a934-f0cfc9c745f7 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1011083 Dec 20 05:55:43.339151 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 75f0ad55-bd12-4474-9eb7-d4482ab761b1 {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:55:43.352179 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:43.365148 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Transition to ACTIVE for port object 75f0ad55-bd12-4474-9eb7-d4482ab761b1 will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 05:55:43.368991 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:43.417464 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Pushing event updated for resources: {'Port': ['ID=75f0ad55-bd12-4474-9eb7-d4482ab761b1,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:43.493512 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Attempting to bind port 75f0ad55-bd12-4474-9eb7-d4482ab761b1 on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:55:43.493853 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Attempting to bind port 75f0ad55-bd12-4474-9eb7-d4482ab761b1 by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': 'e86c45d4-b3d7-41e1-892c-83dec0fca686', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': 'ebca9b29-55b2-47f1-bcfb-6bced6fdc050'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:55:43.494183 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Attempting to bind port 75f0ad55-bd12-4474-9eb7-d4482ab761b1 on network ebca9b29-55b2-47f1-bcfb-6bced6fdc050 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:55:43.498519 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Port 75f0ad55-bd12-4474-9eb7-d4482ab761b1 on network ebca9b29-55b2-47f1-bcfb-6bced6fdc050 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 05:55:43.498841 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Attempting to bind port 75f0ad55-bd12-4474-9eb7-d4482ab761b1 on network ebca9b29-55b2-47f1-bcfb-6bced6fdc050 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:55:43.503661 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 55, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:55:43.503996 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Checking segment: {'id': 'e86c45d4-b3d7-41e1-892c-83dec0fca686', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': 'ebca9b29-55b2-47f1-bcfb-6bced6fdc050'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:55:43.504376 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Bound using segment: {'id': 'e86c45d4-b3d7-41e1-892c-83dec0fca686', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': 'ebca9b29-55b2-47f1-bcfb-6bced6fdc050'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:55:43.504796 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Bound port: 75f0ad55-bd12-4474-9eb7-d4482ab761b1, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e86c45d4-b3d7-41e1-892c-83dec0fca686', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': 'ebca9b29-55b2-47f1-bcfb-6bced6fdc050'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:55:43.505146 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:43.577852 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] For port 75f0ad55-bd12-4474-9eb7-d4482ab761b1, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:55:43.581844 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] For port 75f0ad55-bd12-4474-9eb7-d4482ab761b1, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=75f0ad55-bd12-4474-9eb7-d4482ab761b1,segment=NetworkSegment(e86c45d4-b3d7-41e1-892c-83dec0fca686),segment_id=e86c45d4-b3d7-41e1-892c-83dec0fca686)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:55:43.586845 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:43.633345 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:43.634054 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:43.635536 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] 10.222.0.54 "PUT /v2.0/ports/75f0ad55-bd12-4474-9eb7-d4482ab761b1 HTTP/1.1" status: 200 len: 1093 time: 0.7080030 Dec 20 05:55:43.635987 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c13f9a32-2218-44b3-9e80-d74fe7492eaf', 'tag': '75f0ad55-bd12-4474-9eb7-d4482ab761b1'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:55:43.638255 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d66117ce-ffe6-4583-90be-8dbaae3371af" -d '{"events": [{"name": "network-changed", "server_uuid": "c13f9a32-2218-44b3-9e80-d74fe7492eaf", "tag": "75f0ad55-bd12-4474-9eb7-d4482ab761b1"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:55:43.672349 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0c39ab6-2164-42d9-ad15-503009a72281 service neutron] Pushing event updated for resources: {'Port': ['ID=75f0ad55-bd12-4474-9eb7-d4482ab761b1,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:43.802223 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57a9e4fc-84e5-4696-9608-3c7043cdaf57 req-20096918-8668-4f02-b78d-9bd2210a21f5 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:43.803754 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-57a9e4fc-84e5-4696-9608-3c7043cdaf57 req-20096918-8668-4f02-b78d-9bd2210a21f5 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.1209171 Dec 20 05:55:43.821296 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc5c93e6-2543-4b88-8a7b-520c7002276f req-80a9671d-3887-4e74-8169-304834493fcc tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:43.824282 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc5c93e6-2543-4b88-8a7b-520c7002276f req-80a9671d-3887-4e74-8169-304834493fcc tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.1149316 Dec 20 05:55:43.829047 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-46992627-f88b-429f-94c4-ea44da00fabf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:43.830721 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-46992627-f88b-429f-94c4-ea44da00fabf service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=c55e4805e4ec461e98ab84a95a8755d7&device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 1096 time: 0.1097226 Dec 20 05:55:43.909389 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-7b6adb3b-81b7-4852-b4cc-b86d6888f836 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=75f0ad55-bd12-4474-9eb7-d4482ab761b1 HTTP/1.1" status: 200 len: 217 time: 0.0526309 Dec 20 05:55:43.965896 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-57a9e4fc-84e5-4696-9608-3c7043cdaf57 req-c0a200d4-29c4-4f73-8352-880df0592790 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1397948 Dec 20 05:55:43.969691 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dc5c93e6-2543-4b88-8a7b-520c7002276f req-45503996-6c13-4372-ad60-98248d39a9f7 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1335394 Dec 20 05:55:43.998654 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-a58afccb-ec92-40d2-b4b3-c149f82174bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:44.000794 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-a58afccb-ec92-40d2-b4b3-c149f82174bf service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2c54f9a1-64d2-45bf-94c0-c7d4cd8d6225 HTTP/1.1" status: 200 len: 849 time: 0.0716951 Dec 20 05:55:44.023341 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:55:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7ffade2d-9922-4951-ab7f-f79e3147fdd5 x-openstack-request-id: req-7ffade2d-9922-4951-ab7f-f79e3147fdd5 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:55:44.023732 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c13f9a32-2218-44b3-9e80-d74fe7492eaf", "tag": "75f0ad55-bd12-4474-9eb7-d4482ab761b1", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:55:44.024058 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-7ffade2d-9922-4951-ab7f-f79e3147fdd5 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:55:44.024543 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c13f9a32-2218-44b3-9e80-d74fe7492eaf', 'tag': '75f0ad55-bd12-4474-9eb7-d4482ab761b1', 'status': 'completed', 'code': 200} Dec 20 05:55:44.044002 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-abfdad6c-71ef-4f6d-8feb-d11064bfeff4 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ebca9b29-55b2-47f1-bcfb-6bced6fdc050&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0317631 Dec 20 05:55:44.151255 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-514f51f4-78b6-4eb8-b7ed-8f4f31b47043 service neutron] 10.222.0.54 "GET /v2.0/networks/ebca9b29-55b2-47f1-bcfb-6bced6fdc050?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0896785 Dec 20 05:55:44.252028 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dfff36e7-e726-4784-b6d4-db23bf8124fd req-6f28ad18-3947-4ced-b7fc-dd041465b385 service neutron] 10.222.0.54 "GET /v2.0/networks/ebca9b29-55b2-47f1-bcfb-6bced6fdc050?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0929644 Dec 20 05:55:44.401209 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d66117ce-ffe6-4583-90be-8dbaae3371af req-0747cb56-417f-4f4a-829f-bec03e11a6b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:44.402801 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d66117ce-ffe6-4583-90be-8dbaae3371af req-0747cb56-417f-4f4a-829f-bec03e11a6b9 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=c55e4805e4ec461e98ab84a95a8755d7&device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 1096 time: 0.0450516 Dec 20 05:55:44.509085 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ba2e2d-605a-472f-ae9d-29cbaab07e3e req-f406feab-17ef-4756-9d6d-ba6c546fd959 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:44.510845 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-89ba2e2d-605a-472f-ae9d-29cbaab07e3e req-f406feab-17ef-4756-9d6d-ba6c546fd959 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 943 time: 0.1069577 Dec 20 05:55:44.550757 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d66117ce-ffe6-4583-90be-8dbaae3371af req-a7c71a9a-734c-496f-aa6c-9ff5da1e1768 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:44.552322 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d66117ce-ffe6-4583-90be-8dbaae3371af req-a7c71a9a-734c-496f-aa6c-9ff5da1e1768 service neutron] 10.222.0.54 "GET /v2.0/networks?id=ebca9b29-55b2-47f1-bcfb-6bced6fdc050 HTTP/1.1" status: 200 len: 910 time: 0.1226332 Dec 20 05:55:44.610192 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d66117ce-ffe6-4583-90be-8dbaae3371af req-3ed0532d-eef7-40a8-952b-f1e24fe1d6ef service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=75f0ad55-bd12-4474-9eb7-d4482ab761b1 HTTP/1.1" status: 200 len: 217 time: 0.0467958 Dec 20 05:55:44.613640 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-89ba2e2d-605a-472f-ae9d-29cbaab07e3e req-a27cda5a-c919-474e-9854-30aa26449364 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0958889 Dec 20 05:55:44.664695 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d66117ce-ffe6-4583-90be-8dbaae3371af req-063500fb-c760-4f29-aabd-4d415d3aa4c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:44.666359 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d66117ce-ffe6-4583-90be-8dbaae3371af req-063500fb-c760-4f29-aabd-4d415d3aa4c1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2c54f9a1-64d2-45bf-94c0-c7d4cd8d6225 HTTP/1.1" status: 200 len: 849 time: 0.0450671 Dec 20 05:55:44.707369 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d66117ce-ffe6-4583-90be-8dbaae3371af req-897041f3-da16-4172-be04-5ac30a84d1b2 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ebca9b29-55b2-47f1-bcfb-6bced6fdc050&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0276246 Dec 20 05:55:44.812283 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d66117ce-ffe6-4583-90be-8dbaae3371af req-f1892658-622d-437e-a230-f5bccc997b29 service neutron] 10.222.0.54 "GET /v2.0/networks/ebca9b29-55b2-47f1-bcfb-6bced6fdc050?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0968630 Dec 20 05:55:44.904487 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d66117ce-ffe6-4583-90be-8dbaae3371af req-2b80bdb6-3de0-474a-a1fd-5f2d9eac6d39 service neutron] 10.222.0.54 "GET /v2.0/networks/ebca9b29-55b2-47f1-bcfb-6bced6fdc050?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849397 Dec 20 05:55:45.127759 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d60f25da-f020-49fe-98dd-504cbd0b6f9b req-30d67c4c-ab71-4a2f-9398-1d3cdc9a7387 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:45.129291 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d60f25da-f020-49fe-98dd-504cbd0b6f9b req-30d67c4c-ab71-4a2f-9398-1d3cdc9a7387 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0853245 Dec 20 05:55:45.140119 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-953d4360-2604-4acf-84fc-6264e9a32192 req-d859841b-b2cb-4e31-a317-78caeefbffb3 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:45.141541 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-953d4360-2604-4acf-84fc-6264e9a32192 req-d859841b-b2cb-4e31-a317-78caeefbffb3 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0963812 Dec 20 05:55:45.206466 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d60f25da-f020-49fe-98dd-504cbd0b6f9b req-e0681727-a2ca-4b95-837b-e7401bc5be5c tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0639589 Dec 20 05:55:45.224006 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-953d4360-2604-4acf-84fc-6264e9a32192 req-3979cb92-b7d9-4dc2-91a7-1793f95afa0a tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0687606 Dec 20 05:55:45.739224 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1a14145-89dd-49fe-b2a0-113d55f14474 req-08988917-a3f7-44cb-a954-4b72dbfb6ff1 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:45.740621 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a1a14145-89dd-49fe-b2a0-113d55f14474 req-08988917-a3f7-44cb-a954-4b72dbfb6ff1 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 943 time: 0.0484624 Dec 20 05:55:45.788678 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a1a14145-89dd-49fe-b2a0-113d55f14474 req-ae953056-d862-4544-a1d5-8d306d3eda17 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413816 Dec 20 05:55:45.971185 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:55:46.330614 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79e7918b-64b0-4b21-a7b2-5f708c8fd668 req-aa67ba4d-f540-48f4-a8e0-b6394b117e03 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:46.333188 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-79e7918b-64b0-4b21-a7b2-5f708c8fd668 req-aa67ba4d-f540-48f4-a8e0-b6394b117e03 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0526106 Dec 20 05:55:46.378527 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-79e7918b-64b0-4b21-a7b2-5f708c8fd668 req-751adfc7-3a1c-47cc-ac72-09eecc291ab5 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405805 Dec 20 05:55:46.595852 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 45902) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:46.702894 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:46.783881 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:46.788538 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:46.849799 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=04ac8bd5ba724588ab86800437e92e33&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2527499 Dec 20 05:55:46.851305 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4e712757-e38b-4fe6-ba20-2b6d63d7c881,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:46.852412 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 45912) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:46.859666 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:46.860088 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:46.860567 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:46.860958 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:46.861348 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:46.861734 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:46.862134 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:46.862531 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:46.863008 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:46.863424 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:46.863840 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:46.864227 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:46.864619 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8511b677-5a95-4e59-91ac-7f5cdbc9f94d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:46.930703 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 75f0ad55-bd12-4474-9eb7-d4482ab761b1 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:55:46.953349 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-df02ec2f-fe53-4e3d-b119-c897383ff29b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:46.965550 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df00eab0-6e7d-464d-a3be-3f17ae45430a req-0285ec14-06e8-4a71-af67-def6f013c919 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:46.967085 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-df00eab0-6e7d-464d-a3be-3f17ae45430a req-0285ec14-06e8-4a71-af67-def6f013c919 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 943 time: 0.0796008 Dec 20 05:55:46.992521 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-df02ec2f-fe53-4e3d-b119-c897383ff29b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:47.034266 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 75f0ad55-bd12-4474-9eb7-d4482ab761b1, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=75f0ad55-bd12-4474-9eb7-d4482ab761b1,segment=NetworkSegment(e86c45d4-b3d7-41e1-892c-83dec0fca686),segment_id=e86c45d4-b3d7-41e1-892c-83dec0fca686)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:47.045863 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '75f0ad55-bd12-4474-9eb7-d4482ab761b1', 'network_id': 'ebca9b29-55b2-47f1-bcfb-6bced6fdc050', 'port_id': '75f0ad55-bd12-4474-9eb7-d4482ab761b1', 'mac_address': 'fa:16:3e:e0:3b:83', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 403, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2c54f9a1-64d2-45bf-94c0-c7d4cd8d6225', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:55:47.054331 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-df00eab0-6e7d-464d-a3be-3f17ae45430a req-aa660d4c-bdab-4ed0-8845-a4b04427d04c tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765033 Dec 20 05:55:47.083154 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:47.085438 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-df02ec2f-fe53-4e3d-b119-c897383ff29b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:47.088983 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-df02ec2f-fe53-4e3d-b119-c897383ff29b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:47.090119 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-df02ec2f-fe53-4e3d-b119-c897383ff29b admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/4e712757-e38b-4fe6-ba20-2b6d63d7c881 HTTP/1.1" status: 204 len: 168 time: 0.2365396 Dec 20 05:55:47.096615 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 75f0ad55-bd12-4474-9eb7-d4482ab761b1 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:55:47.098127 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df02ec2f-fe53-4e3d-b119-c897383ff29b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4e712757-e38b-4fe6-ba20-2b6d63d7c881,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:47.124472 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 75f0ad55-bd12-4474-9eb7-d4482ab761b1, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=75f0ad55-bd12-4474-9eb7-d4482ab761b1,segment=NetworkSegment(e86c45d4-b3d7-41e1-892c-83dec0fca686),segment_id=e86c45d4-b3d7-41e1-892c-83dec0fca686)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:47.129685 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:47.179986 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=75f0ad55-bd12-4474-9eb7-d4482ab761b1,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:47.494128 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f36eedd9-58f7-4fc6-aa5c-81f3a173dff8 req-b0a6d1a8-bf72-4ded-afaf-ebb6da6958eb tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:47.496195 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f36eedd9-58f7-4fc6-aa5c-81f3a173dff8 req-b0a6d1a8-bf72-4ded-afaf-ebb6da6958eb tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0489931 Dec 20 05:55:47.512028 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['75f0ad55-bd12-4474-9eb7-d4482ab761b1'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:55:47.544094 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f36eedd9-58f7-4fc6-aa5c-81f3a173dff8 req-19fe6b0d-c6b4-45f8-a243-b9ba664a4293 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420628 Dec 20 05:55:48.172249 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-255849aa-2405-463d-b69d-e35b245e882d req-2c646b5c-ba3d-4f9b-93da-f3115104b3fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:48.173700 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-255849aa-2405-463d-b69d-e35b245e882d req-2c646b5c-ba3d-4f9b-93da-f3115104b3fd tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 944 time: 0.0475683 Dec 20 05:55:48.219361 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-255849aa-2405-463d-b69d-e35b245e882d req-f31f26b5-0fcb-4628-872c-be2573364132 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398219 Dec 20 05:55:48.660629 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99947c97-60a6-40da-845e-29a696c25c72 req-d4a96f62-a480-492b-ae7c-8686fcc43660 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:48.662016 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-99947c97-60a6-40da-845e-29a696c25c72 req-d4a96f62-a480-492b-ae7c-8686fcc43660 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0507820 Dec 20 05:55:48.707683 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-99947c97-60a6-40da-845e-29a696c25c72 req-08bc773d-8b7e-4f5e-8a03-487de9ce1ee7 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391066 Dec 20 05:55:48.947031 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 75f0ad55-bd12-4474-9eb7-d4482ab761b1 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:55:48.994568 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port 75f0ad55-bd12-4474-9eb7-d4482ab761b1 completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 05:55:48.999081 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 75f0ad55-bd12-4474-9eb7-d4482ab761b1 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:48.999472 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:49.086642 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:49.110968 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c13f9a32-2218-44b3-9e80-d74fe7492eaf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75f0ad55-bd12-4474-9eb7-d4482ab761b1'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:55:49.113647 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-87c2b52e-1a92-4a15-b3f6-f3a93a029ecf" -d '{"events": [{"server_uuid": "c13f9a32-2218-44b3-9e80-d74fe7492eaf", "name": "network-vif-plugged", "status": "completed", "tag": "75f0ad55-bd12-4474-9eb7-d4482ab761b1"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:55:49.128097 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 75f0ad55-bd12-4474-9eb7-d4482ab761b1, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=75f0ad55-bd12-4474-9eb7-d4482ab761b1,segment=NetworkSegment(e86c45d4-b3d7-41e1-892c-83dec0fca686),segment_id=e86c45d4-b3d7-41e1-892c-83dec0fca686)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:49.132930 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:49.156660 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:55:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd595d9f-ebb1-44c8-b969-0e14849affc7 x-openstack-request-id: req-bd595d9f-ebb1-44c8-b969-0e14849affc7 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:55:49.156972 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c13f9a32-2218-44b3-9e80-d74fe7492eaf", "name": "network-vif-plugged", "status": "completed", "tag": "75f0ad55-bd12-4474-9eb7-d4482ab761b1", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:55:49.157231 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-bd595d9f-ebb1-44c8-b969-0e14849affc7 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:55:49.157674 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c13f9a32-2218-44b3-9e80-d74fe7492eaf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75f0ad55-bd12-4474-9eb7-d4482ab761b1', 'code': 200} Dec 20 05:55:49.182154 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=75f0ad55-bd12-4474-9eb7-d4482ab761b1,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:49.341292 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4a74349-b5ae-4e5a-88d7-567319c2bfe7 req-001ad5bc-9d5b-4ef9-85ef-da8869819714 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:49.342778 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a4a74349-b5ae-4e5a-88d7-567319c2bfe7 req-001ad5bc-9d5b-4ef9-85ef-da8869819714 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 945 time: 0.0507081 Dec 20 05:55:49.353239 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 45946) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:49.427839 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a4a74349-b5ae-4e5a-88d7-567319c2bfe7 req-eb2ad247-f28f-4710-8cc6-c7d86f94fc55 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0783970 Dec 20 05:55:49.437337 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c2f2fc8-d6ae-40fa-82d5-7582ced8ecb3 req-91e20bc4-2177-429f-97df-90e6a6f941d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:49.438777 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0c2f2fc8-d6ae-40fa-82d5-7582ced8ecb3 req-91e20bc4-2177-429f-97df-90e6a6f941d3 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 1098 time: 0.0631604 Dec 20 05:55:49.469084 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9f6649c2-790d-4985-b338-1214832a1030 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:49.483449 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0c2f2fc8-d6ae-40fa-82d5-7582ced8ecb3 req-e79e9a5b-de89-49ab-ac0f-2469150dc2b4 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0368955 Dec 20 05:55:49.540979 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9f6649c2-790d-4985-b338-1214832a1030 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:49.544797 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9f6649c2-790d-4985-b338-1214832a1030 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:49.583049 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-9f6649c2-790d-4985-b338-1214832a1030 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=61e4a8fb4b0844f2a099321fcd44657e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2287500 Dec 20 05:55:49.583930 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f6649c2-790d-4985-b338-1214832a1030 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c1a849a-dea2-4339-8f8d-b7002d64a4a0,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:49.585716 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 45950) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:49.637375 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-88312d7e-1784-43f5-8c68-79768c300804 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:49.659014 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-88312d7e-1784-43f5-8c68-79768c300804 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:49.709927 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-88312d7e-1784-43f5-8c68-79768c300804 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:49.712912 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-88312d7e-1784-43f5-8c68-79768c300804 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:49.714371 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-88312d7e-1784-43f5-8c68-79768c300804 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/1c1a849a-dea2-4339-8f8d-b7002d64a4a0 HTTP/1.1" status: 204 len: 168 time: 0.1276684 Dec 20 05:55:49.722253 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88312d7e-1784-43f5-8c68-79768c300804 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c1a849a-dea2-4339-8f8d-b7002d64a4a0,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:49.826046 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2767ed-ddda-4a7d-9d52-c763fb925dcd req-ce6d5cc3-8515-4731-9256-37459ea8d99e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:49.827549 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-be2767ed-ddda-4a7d-9d52-c763fb925dcd req-ce6d5cc3-8515-4731-9256-37459ea8d99e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0512018 Dec 20 05:55:49.878086 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-be2767ed-ddda-4a7d-9d52-c763fb925dcd req-54a44b7b-7548-499f-a387-04dbe895a0ea tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442135 Dec 20 05:55:50.328160 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 45976) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:50.425605 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1060998211-network', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:50.447778 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] Made reservation on behalf of a67a7ba727e54b1c9f6ca2d5ea21f272 for: {'network': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:55:50.449968 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:50.458544 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:50.571981 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b737532-c5b4-4cf9-939d-aad3107701e3 req-dafa1a8b-50b8-40e7-82d3-7b389902133e tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:50.573379 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8b737532-c5b4-4cf9-939d-aad3107701e3 req-dafa1a8b-50b8-40e7-82d3-7b389902133e tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 945 time: 0.0767519 Dec 20 05:55:50.575101 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:50.579078 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:50.621263 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] vlan segment allocate from pool success with {'vlan_id': 407, 'physical_network': 'physnet1'} {{(pid=102445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:55:50.634479 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e8c049b-658c-4e33-ab52-8f9fa7f9b332,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:50.645605 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:50.645950 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.segments_db [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] Added segment e14b6241-3561-4b23-bd30-af836d346b40 of type vlan for network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 Dec 20 05:55:50.691199 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8b737532-c5b4-4cf9-939d-aad3107701e3 req-6a014a70-4e28-4ed8-b90d-2c94c1e76310 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1087530 Dec 20 05:55:50.702523 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:50.726827 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:50.727921 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:50.728544 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:50.764475 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4352312 Dec 20 05:55:50.767761 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 45982) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:50.772716 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-919cc975-a3d7-42a0-9357-748959609170 admin admin] Request body: {'subnet': {'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1060998211-subnet', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'ip_version': 4}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:50.791469 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62b56a79-08d8-461c-8306-d3cc38a9b8c1 admin admin] Pushing event updated for resources: {'Network': ['ID=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:50.803644 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:55:50.804283 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-919cc975-a3d7-42a0-9357-748959609170 admin admin] Made reservation on behalf of a67a7ba727e54b1c9f6ca2d5ea21f272 for: {'subnet': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:55:50.807146 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-919cc975-a3d7-42a0-9357-748959609170 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3270951'] for subnet, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:50.983782 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-919cc975-a3d7-42a0-9357-748959609170 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9168037', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3270985'] for subnet, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:50.998536 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5388139-cf1b-40ed-9d75-48d794735bc3 req-e784329d-1ef0-4805-97c5-9b68e786af54 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:51.000038 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f5388139-cf1b-40ed-9d75-48d794735bc3 req-e784329d-1ef0-4805-97c5-9b68e786af54 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0502226 Dec 20 05:55:51.032239 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-919cc975-a3d7-42a0-9357-748959609170 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a2b892f1-223d-4384-8544-8bbbbe5c621b,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:51.047481 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-919cc975-a3d7-42a0-9357-748959609170 admin admin] Checking segment: {'id': 'e14b6241-3561-4b23-bd30-af836d346b40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 407, 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:55:51.047864 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-919cc975-a3d7-42a0-9357-748959609170 admin admin] Network hostable DHCP agents. Network: 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102446) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:55:51.048786 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f5388139-cf1b-40ed-9d75-48d794735bc3 req-60696f41-8579-4a82-a9db-406ec10159ed tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426633 Dec 20 05:55:51.064151 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-919cc975-a3d7-42a0-9357-748959609170 admin admin] Network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102446) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:55:51.072344 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-919cc975-a3d7-42a0-9357-748959609170 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3) {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:55:51.076329 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-919cc975-a3d7-42a0-9357-748959609170 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:51.076921 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-919cc975-a3d7-42a0-9357-748959609170 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.081857 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa5e121a-0171-497c-b228-e1bedcaa1b70 None None] Network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:55:51.092873 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-919cc975-a3d7-42a0-9357-748959609170 admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3239334 Dec 20 05:55:51.095499 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 45986) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:51.099687 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:51.123928 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1698740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25959'] for router, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.125132 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1698340', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1703163', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1634740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25982'] for router, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.189287 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.191023 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf82c7edd-7168-52b9-b9ff-dee431eec71c-0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'fixed_ips': [{'subnet_id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b'}]}} from dv-cinder-822278-1-iscsi. {{(pid=102447) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 20 05:55:51.192022 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.324160 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.330932 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.db_base_plugin_common [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Allocated IP 172.20.0.2 (0dda46a2-d87a-46ca-89fc-3cf651bd2fc3/a2b892f1-223d-4384-8544-8bbbbe5c621b/9986f966-f215-4a93-bea7-4c19b71eb341) {{(pid=102447) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:55:51.467292 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Publish callbacks [] for port, precommit_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.473002 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.514314 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 is already hosted by enough agents. {{(pid=102447) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:55:51.517743 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.base_scheduler [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Resources bound (agent type, host, resource id): {{(pid=102447) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:55:51.520231 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Received port after_create {{(pid=102447) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:55:51.525607 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.528912 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Pushing event updated for resources: {'Port': ['ID=9986f966-f215-4a93-bea7-4c19b71eb341,revision_number=1']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:51.548183 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.583341 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Attempting to bind port 9986f966-f215-4a93-bea7-4c19b71eb341 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:55:51.583747 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Attempting to bind port 9986f966-f215-4a93-bea7-4c19b71eb341 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': 'e14b6241-3561-4b23-bd30-af836d346b40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 407, 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:55:51.584101 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Attempting to bind port 9986f966-f215-4a93-bea7-4c19b71eb341 on network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:55:51.589034 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 55, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:55:51.589504 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Checking segment: {'id': 'e14b6241-3561-4b23-bd30-af836d346b40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 407, 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:55:51.589913 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.590292 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Bound using segment: {'id': 'e14b6241-3561-4b23-bd30-af836d346b40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 407, 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:55:51.590752 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Bound port: 9986f966-f215-4a93-bea7-4c19b71eb341, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e14b6241-3561-4b23-bd30-af836d346b40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 407, 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:55:51.591124 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.653461 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Allocated IP 172.27.3.28 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/973d22fc-4c72-4242-98d2-520773fe8892) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:55:51.655672 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] For port 9986f966-f215-4a93-bea7-4c19b71eb341, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:55:51.658638 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] For port 9986f966-f215-4a93-bea7-4c19b71eb341, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=9986f966-f215-4a93-bea7-4c19b71eb341,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:55:51.662506 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.728763 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28ac4968-c778-453d-9143-91fb0bb58dc8 None None] Pushing event updated for resources: {'Port': ['ID=9986f966-f215-4a93-bea7-4c19b71eb341,revision_number=2']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:51.757046 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.792336 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:51.828045 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e50745d-7ad2-4657-8f9f-16ae612f7e9e req-1c616df4-669b-4741-8fe6-c543bcbbda88 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:51.832606 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3e50745d-7ad2-4657-8f9f-16ae612f7e9e req-1c616df4-669b-4741-8fe6-c543bcbbda88 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 945 time: 0.0582483 Dec 20 05:55:51.837557 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:55:51.840472 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:55:51.843813 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:55:51.849259 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Pushing event updated for resources: {'Port': ['ID=973d22fc-4c72-4242-98d2-520773fe8892,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:51.897794 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3e50745d-7ad2-4657-8f9f-16ae612f7e9e req-75a2a46b-2c04-498b-985b-f9f649a6ec8d tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580018 Dec 20 05:55:52.177789 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11dbaeff-a063-4686-a121-4d16cf0f52bb req-7921501b-1430-48d7-9a76-6e1c5377745a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:52.179339 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-11dbaeff-a063-4686-a121-4d16cf0f52bb req-7921501b-1430-48d7-9a76-6e1c5377745a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0569742 Dec 20 05:55:52.243712 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-11dbaeff-a063-4686-a121-4d16cf0f52bb req-57e67c40-c7e5-4200-8642-3210937e384c tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570047 Dec 20 05:55:52.356744 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:52.571561 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1698355', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1703078'] for router, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:52.734088 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Router 728e739d-afec-42c9-b7f9-65837b18602c is scheduled to L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d with binding_index 1 {{(pid=102446) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 20 05:55:52.832431 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d02cf56-2ab4-4991-b9f0-fcaf6fe25025 None None] Network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:55:52.833748 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76c72386-91c6-4433-a2d9-ef8ebdce3b1d req-6ab8d363-de7c-475a-99af-e07b65bdfafc tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:52.839247 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-76c72386-91c6-4433-a2d9-ef8ebdce3b1d req-6ab8d363-de7c-475a-99af-e07b65bdfafc tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 945 time: 0.0576577 Dec 20 05:55:52.865987 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:55:52.868417 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-974586ab-6faf-44d3-8ead-0de4a8c1fda0 None None] Provisioning complete for port 9986f966-f215-4a93-bea7-4c19b71eb341 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:52.868783 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-974586ab-6faf-44d3-8ead-0de4a8c1fda0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:52.877915 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Sync routers for ids ['728e739d-afec-42c9-b7f9-65837b18602c'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:55:52.888706 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] Publish callbacks [] for router, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:52.889256 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Routers {'728e739d-afec-42c9-b7f9-65837b18602c'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:55:52.889877 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:55:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['728e739d-afec-42c9-b7f9-65837b18602c'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:55:52.890923 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-df1d0a9d-13e9-476d-aeac-9eda83321c42 admin admin] 10.222.0.46 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.7937701 Dec 20 05:55:52.892980 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46010) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:52.927586 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-76c72386-91c6-4433-a2d9-ef8ebdce3b1d req-c6c784db-7809-498f-98a5-10b2723dd7a2 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0783377 Dec 20 05:55:52.998160 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-974586ab-6faf-44d3-8ead-0de4a8c1fda0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:53.004713 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Set router 728e739d-afec-42c9-b7f9-65837b18602c gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:55:53.050058 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-974586ab-6faf-44d3-8ead-0de4a8c1fda0 None None] For port 9986f966-f215-4a93-bea7-4c19b71eb341, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=9986f966-f215-4a93-bea7-4c19b71eb341,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:53.055979 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-974586ab-6faf-44d3-8ead-0de4a8c1fda0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:53.111649 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-974586ab-6faf-44d3-8ead-0de4a8c1fda0 None None] Pushing event updated for resources: {'Port': ['ID=9986f966-f215-4a93-bea7-4c19b71eb341,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:53.204444 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28'}], 'enable_snat': True}, 'gw_port_id': '973d22fc-4c72-4242-98d2-520773fe8892', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:52Z', 'revision_number': 3, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port': {'id': '973d22fc-4c72-4242-98d2-520773fe8892', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:1e:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:51Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:55:53.242631 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Checking router: 728e739d-afec-42c9-b7f9-65837b18602c for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:55:53.249676 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Updating router 728e739d-afec-42c9-b7f9-65837b18602c port 973d22fc-4c72-4242-98d2-520773fe8892 binding host dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:55:53.280142 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:53.293315 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-c6040170-723a-42ac-be0c-8df36e365110 None None] Provisioning complete for port 9986f966-f215-4a93-bea7-4c19b71eb341 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:53.293769 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-c6040170-723a-42ac-be0c-8df36e365110 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:53.383249 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:53.393936 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db4e841-d75a-4ff0-a222-702d79f0e39e req-9786ba64-88ed-4c3c-98ae-3260a8851580 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:53.398696 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1db4e841-d75a-4ff0-a222-702d79f0e39e req-9786ba64-88ed-4c3c-98ae-3260a8851580 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0639377 Dec 20 05:55:53.444335 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1db4e841-d75a-4ff0-a222-702d79f0e39e req-17ef9329-f9f2-4e2a-a850-2e567d9271a4 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426879 Dec 20 05:55:53.546402 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Allocated IP 172.20.0.1 (0dda46a2-d87a-46ca-89fc-3cf651bd2fc3/a2b892f1-223d-4384-8544-8bbbbe5c621b/43066bfd-26eb-4a35-9f53-02e9ff2e6c84) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:55:53.556320 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Publish callbacks [] for port, precommit_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:53.561833 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:53.617345 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2711a992-7936-412b-862b-0e2297feb672 None None] Pushing event updated for resources: {'Port': ['ID=973d22fc-4c72-4242-98d2-520773fe8892,revision_number=2']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:53.623614 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Attempting to bind port 973d22fc-4c72-4242-98d2-520773fe8892 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:55:53.623993 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Attempting to bind port 973d22fc-4c72-4242-98d2-520773fe8892 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:55:53.624376 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Attempting to bind port 973d22fc-4c72-4242-98d2-520773fe8892 on network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:55:53.629300 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 55, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:55:53.629675 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Checking segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102448) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:55:53.630080 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:53.630480 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Bound using segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:55:53.630975 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Bound port: 973d22fc-4c72-4242-98d2-520773fe8892, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:55:53.631369 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:53.650795 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:53.683412 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] For port 973d22fc-4c72-4242-98d2-520773fe8892, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102448) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:55:53.684344 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:53.687175 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] For port 973d22fc-4c72-4242-98d2-520773fe8892, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=973d22fc-4c72-4242-98d2-520773fe8892,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102448) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:55:53.691615 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:53.725500 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:55:53.730710 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:55:53.734190 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:55:53.741947 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Routers {'728e739d-afec-42c9-b7f9-65837b18602c'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:55:53.742607 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:55:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['728e739d-afec-42c9-b7f9-65837b18602c'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:55:53.770458 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Pushing event updated for resources: {'Port': ['ID=43066bfd-26eb-4a35-9f53-02e9ff2e6c84,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:53.785165 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1703675'] for router_interface, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:53.857469 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] Set router 728e739d-afec-42c9-b7f9-65837b18602c gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:55:53.906603 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 9986f966-f215-4a93-bea7-4c19b71eb341 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:55:53.951456 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:53.956572 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2711a992-7936-412b-862b-0e2297feb672 None None] Pushing event updated for resources: {'Port': ['ID=973d22fc-4c72-4242-98d2-520773fe8892,revision_number=3']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:53.992288 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 9986f966-f215-4a93-bea7-4c19b71eb341 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:53.992950 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:54.050974 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-d2b32b89-4b04-4575-a785-b2cd0b3a7d51 None None] Provisioning complete for port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:54.051637 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-d2b32b89-4b04-4575-a785-b2cd0b3a7d51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:54.065286 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f750b91-c5b3-43df-abe5-da4af5391820 req-30fe0327-108d-4340-b7b9-be5a0f977e8f tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:54.067006 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8f750b91-c5b3-43df-abe5-da4af5391820 req-30fe0327-108d-4340-b7b9-be5a0f977e8f tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 945 time: 0.0529528 Dec 20 05:55:54.100267 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28'}], 'enable_snat': True}, 'gw_port_id': '973d22fc-4c72-4242-98d2-520773fe8892', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:52Z', 'revision_number': 3, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port': {'id': '973d22fc-4c72-4242-98d2-520773fe8892', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:1e:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:55:54.122642 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-d2b32b89-4b04-4575-a785-b2cd0b3a7d51 None None] Port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:55:54.130266 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8f750b91-c5b3-43df-abe5-da4af5391820 req-7f287807-0151-4344-902f-5ca010f962e3 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566006 Dec 20 05:55:54.144599 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac6e6335-6b41-4418-a048-fb4982710a58 None None] The sync data for ids ['728e739d-afec-42c9-b7f9-65837b18602c'] in dv-cinder-822278-1-iscsi is: [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28'}], 'enable_snat': True}, 'gw_port_id': '973d22fc-4c72-4242-98d2-520773fe8892', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:52Z', 'revision_number': 3, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port': {'id': '973d22fc-4c72-4242-98d2-520773fe8892', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:1e:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:55:54.172229 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:54.179077 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:54.244539 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1617520', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1697131'] for router_interface, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:54.246314 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Pushing event updated for resources: {'Port': ['ID=43066bfd-26eb-4a35-9f53-02e9ff2e6c84,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:54.345060 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:55:54.348400 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:55:54.509370 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Router 728e739d-afec-42c9-b7f9-65837b18602c has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:55:54.642543 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb712cf0-976b-44fa-8e55-86ea4108aa66 req-1838d5da-a2be-49a0-8f00-d3b288ec189a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:54.655070 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-eb712cf0-976b-44fa-8e55-86ea4108aa66 req-1838d5da-a2be-49a0-8f00-d3b288ec189a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.1067431 Dec 20 05:55:54.672092 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-d6e4b49b-f962-462b-8c13-df1002110a4a None None] Provisioning complete for port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:54.672461 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-d6e4b49b-f962-462b-8c13-df1002110a4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:54.747447 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-d6e4b49b-f962-462b-8c13-df1002110a4a None None] Port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:55:54.756019 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-eb712cf0-976b-44fa-8e55-86ea4108aa66 req-93e162f4-9b09-4f47-abbe-0c0137ba3821 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0995121 Dec 20 05:55:54.786414 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48c0169-28f3-4d9b-8bcb-acc1eac93242 req-10603139-321c-454d-9a29-2fd56c385607 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:54.788070 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b48c0169-28f3-4d9b-8bcb-acc1eac93242 req-10603139-321c-454d-9a29-2fd56c385607 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.54 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 945 time: 0.1006081 Dec 20 05:55:54.877076 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:55:54.882713 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-906a24b5-e99f-4d00-a14f-eabdcfda078d admin admin] 10.222.0.46 "PUT /v2.0/routers/728e739d-afec-42c9-b7f9-65837b18602c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9884980 Dec 20 05:55:54.890752 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-b48c0169-28f3-4d9b-8bcb-acc1eac93242 req-28d887ff-270d-4b4a-8ae5-cbce95bb93de tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Deleting port 75f0ad55-bd12-4474-9eb7-d4482ab761b1 {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:55:54.893614 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-b48c0169-28f3-4d9b-8bcb-acc1eac93242 req-28d887ff-270d-4b4a-8ae5-cbce95bb93de tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:54.988982 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-b48c0169-28f3-4d9b-8bcb-acc1eac93242 req-28d887ff-270d-4b4a-8ae5-cbce95bb93de tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] For port 75f0ad55-bd12-4474-9eb7-d4482ab761b1, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=75f0ad55-bd12-4474-9eb7-d4482ab761b1,segment=NetworkSegment(e86c45d4-b3d7-41e1-892c-83dec0fca686),segment_id=e86c45d4-b3d7-41e1-892c-83dec0fca686)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:54.989428 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-b48c0169-28f3-4d9b-8bcb-acc1eac93242 req-28d887ff-270d-4b4a-8ae5-cbce95bb93de tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:55.014533 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-b48c0169-28f3-4d9b-8bcb-acc1eac93242 req-28d887ff-270d-4b4a-8ae5-cbce95bb93de tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Calling delete_port for 75f0ad55-bd12-4474-9eb7-d4482ab761b1 owned by compute:nova {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:55:55.335219 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a562ec-861e-47ac-afd8-1ff2b8d0393d req-300e3f7c-26b3-4f88-a06e-a066e2cfe7b6 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:55.336629 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-82a562ec-861e-47ac-afd8-1ff2b8d0393d req-300e3f7c-26b3-4f88-a06e-a066e2cfe7b6 tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/ports?device_id=c13f9a32-2218-44b3-9e80-d74fe7492eaf HTTP/1.1" status: 200 len: 945 time: 0.0662701 Dec 20 05:55:55.431264 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46052) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:55.432025 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-82a562ec-861e-47ac-afd8-1ff2b8d0393d req-f97fc912-17f9-42bd-a358-355042a7488e tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.46 "GET /v2.0/security-groups?id=42fc834a-104f-4dca-a056-79de62a35aca&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0879488 Dec 20 05:55:55.439132 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-955066821-network', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:55.453285 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-b48c0169-28f3-4d9b-8bcb-acc1eac93242 req-28d887ff-270d-4b4a-8ae5-cbce95bb93de tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:55.469544 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] Made reservation on behalf of d82dce4bc31c44f380b140b751dacc3c for: {'network': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:55:55.472095 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:55.480577 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:55.483026 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28d887ff-270d-4b4a-8ae5-cbce95bb93de tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Pushing event deleted for resources: {'Port': ['ID=75f0ad55-bd12-4474-9eb7-d4482ab761b1,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:55.502368 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['75f0ad55-bd12-4474-9eb7-d4482ab761b1'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:55:55.523384 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-b48c0169-28f3-4d9b-8bcb-acc1eac93242 req-28d887ff-270d-4b4a-8ae5-cbce95bb93de tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] No DVR routers for this DVR port 75f0ad55-bd12-4474-9eb7-d4482ab761b1 on host hv-cinder-82227 {{(pid=102445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 05:55:55.526208 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-b48c0169-28f3-4d9b-8bcb-acc1eac93242 req-28d887ff-270d-4b4a-8ae5-cbce95bb93de tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:55.529580 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b48c0169-28f3-4d9b-8bcb-acc1eac93242 req-28d887ff-270d-4b4a-8ae5-cbce95bb93de tempest-VolumesActionsTest-729011410 tempest-VolumesActionsTest-729011410-project] 10.222.0.54 "DELETE /v2.0/ports/75f0ad55-bd12-4474-9eb7-d4482ab761b1 HTTP/1.1" status: 204 len: 173 time: 0.7343910 Dec 20 05:55:55.530018 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c13f9a32-2218-44b3-9e80-d74fe7492eaf', 'name': 'network-vif-deleted', 'tag': '75f0ad55-bd12-4474-9eb7-d4482ab761b1'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:55:55.532428 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3ac878ae-737c-4921-ba4f-9b1f5dda1719" -d '{"events": [{"server_uuid": "c13f9a32-2218-44b3-9e80-d74fe7492eaf", "name": "network-vif-deleted", "tag": "75f0ad55-bd12-4474-9eb7-d4482ab761b1"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:55:55.573533 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:55.577350 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:55.586548 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:55:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-abe72caa-c88d-4a7e-9b10-a8cc931d3827 x-openstack-request-id: req-abe72caa-c88d-4a7e-9b10-a8cc931d3827 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:55:55.586871 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c13f9a32-2218-44b3-9e80-d74fe7492eaf", "name": "network-vif-deleted", "tag": "75f0ad55-bd12-4474-9eb7-d4482ab761b1", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:55:55.587110 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-abe72caa-c88d-4a7e-9b10-a8cc931d3827 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:55:55.587706 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c13f9a32-2218-44b3-9e80-d74fe7492eaf', 'name': 'network-vif-deleted', 'tag': '75f0ad55-bd12-4474-9eb7-d4482ab761b1', 'status': 'completed', 'code': 200} Dec 20 05:55:55.605781 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] vlan segment allocate from pool success with {'vlan_id': 402, 'physical_network': 'physnet1'} {{(pid=102446) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:55:55.612001 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5b9affbd-02c9-4b14-b761-f8b943e36be9,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:55.617804 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:55.618176 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.segments_db [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] Added segment 7b70b34f-119b-467b-94c2-17c9cbdbee98 of type vlan for network 3527cc32-eb9d-47f1-86ed-ee56f32f9073 Dec 20 05:55:55.660098 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:55.686031 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:55.687054 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:55.687868 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:55.733976 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.3014235 Dec 20 05:55:55.737759 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 46056) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:55.744647 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-be6be68c-52ba-46d7-beb0-67c9a5ffa687 admin admin] Request body: {'subnet': {'network_id': '3527cc32-eb9d-47f1-86ed-ee56f32f9073', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-955066821-subnet', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c', 'ip_version': 4}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:55.767103 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e0ecab5-d2d8-4488-944c-403653b5b113 admin admin] Pushing event updated for resources: {'Network': ['ID=3527cc32-eb9d-47f1-86ed-ee56f32f9073,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:55.770829 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be6be68c-52ba-46d7-beb0-67c9a5ffa687 admin admin] Made reservation on behalf of d82dce4bc31c44f380b140b751dacc3c for: {'subnet': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:55:55.780950 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-be6be68c-52ba-46d7-beb0-67c9a5ffa687 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3597747'] for subnet, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:55.781388 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network 3527cc32-eb9d-47f1-86ed-ee56f32f9073 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:55:55.888260 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 973d22fc-4c72-4242-98d2-520773fe8892 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:55:55.940088 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 973d22fc-4c72-4242-98d2-520773fe8892 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:55.941173 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:55.970545 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de9ab406-a0c6-4243-954a-73f830ff9daf req-c2d39e73-090c-47f0-937a-7136a55e53ce tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:55.972199 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-de9ab406-a0c6-4243-954a-73f830ff9daf req-c2d39e73-090c-47f0-937a-7136a55e53ce tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0828216 Dec 20 05:55:56.021581 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:56.045267 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port 973d22fc-4c72-4242-98d2-520773fe8892, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=973d22fc-4c72-4242-98d2-520773fe8892,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:56.051289 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:56.066506 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-de9ab406-a0c6-4243-954a-73f830ff9daf req-7fce0110-f94c-4f88-b1a3-71a8e0add6a7 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0880857 Dec 20 05:55:56.068075 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-be6be68c-52ba-46d7-beb0-67c9a5ffa687 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3457622', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3597789'] for subnet, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:56.132872 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be6be68c-52ba-46d7-beb0-67c9a5ffa687 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d3c4b4eb-e61a-4c53-8658-913dc8e3c2fe,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:56.151623 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be6be68c-52ba-46d7-beb0-67c9a5ffa687 admin admin] Checking segment: {'id': '7b70b34f-119b-467b-94c2-17c9cbdbee98', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': '3527cc32-eb9d-47f1-86ed-ee56f32f9073'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:55:56.152152 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be6be68c-52ba-46d7-beb0-67c9a5ffa687 admin admin] Network hostable DHCP agents. Network: 3527cc32-eb9d-47f1-86ed-ee56f32f9073, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:55:56.161378 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=973d22fc-4c72-4242-98d2-520773fe8892,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:56.167636 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Sync routers for ids ['728e739d-afec-42c9-b7f9-65837b18602c'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:55:56.178155 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be6be68c-52ba-46d7-beb0-67c9a5ffa687 admin admin] Network 3527cc32-eb9d-47f1-86ed-ee56f32f9073 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:55:56.179314 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Routers {'728e739d-afec-42c9-b7f9-65837b18602c'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:55:56.179978 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:55:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['728e739d-afec-42c9-b7f9-65837b18602c'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:55:56.188815 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-be6be68c-52ba-46d7-beb0-67c9a5ffa687 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, 3527cc32-eb9d-47f1-86ed-ee56f32f9073) {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:55:56.200562 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be6be68c-52ba-46d7-beb0-67c9a5ffa687 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:56.201144 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-be6be68c-52ba-46d7-beb0-67c9a5ffa687 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:56.221606 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0036f6e2-ad5f-4b9a-ac5a-f62ed785d3c4 None None] Network 3527cc32-eb9d-47f1-86ed-ee56f32f9073 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:55:56.221833 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-be6be68c-52ba-46d7-beb0-67c9a5ffa687 admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.4796555 Dec 20 05:55:56.222172 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46060) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:56.227163 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-955066821-router', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:55:56.254126 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1698740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25959'] for router, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:56.255787 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1698340', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1703163', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1634740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25982'] for router, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:56.308433 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:56.364840 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Set router 728e739d-afec-42c9-b7f9-65837b18602c gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:55:56.393738 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf82c7edd-7168-52b9-b9ff-dee431eec71c-3527cc32-eb9d-47f1-86ed-ee56f32f9073', 'network_id': '3527cc32-eb9d-47f1-86ed-ee56f32f9073', 'project_id': 'd82dce4bc31c44f380b140b751dacc3c', 'fixed_ips': [{'subnet_id': 'd3c4b4eb-e61a-4c53-8658-913dc8e3c2fe'}]}} from dv-cinder-822278-1-iscsi. {{(pid=102447) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 20 05:55:56.394602 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:56.454476 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:56.650548 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.db_base_plugin_common [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Allocated IP 172.20.0.2 (3527cc32-eb9d-47f1-86ed-ee56f32f9073/d3c4b4eb-e61a-4c53-8658-913dc8e3c2fe/4db19e9b-aab1-4e70-bdfc-44279e419cf3) {{(pid=102447) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:55:56.685042 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:56.714356 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:56.783945 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28'}], 'enable_snat': True}, 'gw_port_id': '973d22fc-4c72-4242-98d2-520773fe8892', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:53Z', 'revision_number': 4, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port': {'id': '973d22fc-4c72-4242-98d2-520773fe8892', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:1e:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '43066bfd-26eb-4a35-9f53-02e9ff2e6c84', 'name': '', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'mac_address': 'fa:16:3e:6c:72:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:53Z', 'updated_at': '2021-12-20T05:55:54Z', 'revision_number': 2, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'subnets': [{'id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:55:56.831423 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Allocated IP 172.27.3.153 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/296558c0-da9a-41e2-8d59-d859119282bb) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:55:56.948620 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:56.949997 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Checking router: 728e739d-afec-42c9-b7f9-65837b18602c for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:55:56.950357 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Updating router 728e739d-afec-42c9-b7f9-65837b18602c port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 binding host dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:55:56.986997 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.001834 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.031274 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Publish callbacks [] for port, precommit_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.037342 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:55:57.040386 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:55:57.045363 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:55:57.048793 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Pushing event updated for resources: {'Port': ['ID=296558c0-da9a-41e2-8d59-d859119282bb,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:57.058732 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.160082 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Network 3527cc32-eb9d-47f1-86ed-ee56f32f9073 is already hosted by enough agents. {{(pid=102447) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:55:57.169492 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.base_scheduler [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Resources bound (agent type, host, resource id): {{(pid=102447) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:55:57.174511 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Pushing event updated for resources: {'Port': ['ID=4db19e9b-aab1-4e70-bdfc-44279e419cf3,revision_number=1']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:57.176771 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Received port after_create {{(pid=102447) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:55:57.262637 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05be2b99-9f9a-4476-800f-36e1bde9a7ad req-4689fd9c-2931-45dd-b8e0-c822e72a16e0 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:57.267460 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-05be2b99-9f9a-4476-800f-36e1bde9a7ad req-4689fd9c-2931-45dd-b8e0-c822e72a16e0 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0611372 Dec 20 05:55:57.313948 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Attempting to bind port 4db19e9b-aab1-4e70-bdfc-44279e419cf3 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:55:57.314325 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Attempting to bind port 4db19e9b-aab1-4e70-bdfc-44279e419cf3 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '7b70b34f-119b-467b-94c2-17c9cbdbee98', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': '3527cc32-eb9d-47f1-86ed-ee56f32f9073'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:55:57.314692 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Attempting to bind port 4db19e9b-aab1-4e70-bdfc-44279e419cf3 on network 3527cc32-eb9d-47f1-86ed-ee56f32f9073 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:55:57.317085 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-05be2b99-9f9a-4476-800f-36e1bde9a7ad req-ad42012d-15a9-434e-95ff-268c480f37b7 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468214 Dec 20 05:55:57.323985 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 55, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:55:57.324365 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Checking segment: {'id': '7b70b34f-119b-467b-94c2-17c9cbdbee98', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': '3527cc32-eb9d-47f1-86ed-ee56f32f9073'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:55:57.324767 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.325185 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Bound using segment: {'id': '7b70b34f-119b-467b-94c2-17c9cbdbee98', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': '3527cc32-eb9d-47f1-86ed-ee56f32f9073'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:55:57.325682 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Bound port: 4db19e9b-aab1-4e70-bdfc-44279e419cf3, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7b70b34f-119b-467b-94c2-17c9cbdbee98', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': '3527cc32-eb9d-47f1-86ed-ee56f32f9073'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:55:57.326099 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.340765 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.445562 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] For port 4db19e9b-aab1-4e70-bdfc-44279e419cf3, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:55:57.450325 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] For port 4db19e9b-aab1-4e70-bdfc-44279e419cf3, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=4db19e9b-aab1-4e70-bdfc-44279e419cf3,segment=NetworkSegment(7b70b34f-119b-467b-94c2-17c9cbdbee98),segment_id=7b70b34f-119b-467b-94c2-17c9cbdbee98)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:55:57.460470 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.468688 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Publish callbacks [] for port, precommit_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.501578 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.538115 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c45d75b-ba00-462d-a0b7-88756efd86a0 None None] Pushing event updated for resources: {'Port': ['ID=4db19e9b-aab1-4e70-bdfc-44279e419cf3,revision_number=2']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:57.553392 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1698355', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1703078'] for router, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.643536 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Attempting to bind port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:55:57.644492 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Attempting to bind port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': 'e14b6241-3561-4b23-bd30-af836d346b40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 407, 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:55:57.644921 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Attempting to bind port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 on network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:55:57.647305 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa267681-cbfb-4a90-a847-7230156d9c32 None None] Pushing event updated for resources: {'Port': ['ID=43066bfd-26eb-4a35-9f53-02e9ff2e6c84,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:57.653385 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 55, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:55:57.654096 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Checking segment: {'id': 'e14b6241-3561-4b23-bd30-af836d346b40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 407, 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:55:57.654297 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.654532 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Bound using segment: {'id': 'e14b6241-3561-4b23-bd30-af836d346b40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 407, 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:55:57.655013 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Bound port: 43066bfd-26eb-4a35-9f53-02e9ff2e6c84, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e14b6241-3561-4b23-bd30-af836d346b40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 407, 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:55:57.655383 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.722593 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Router 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb is scheduled to L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d with binding_index 1 {{(pid=102446) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 20 05:55:57.736768 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] For port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:55:57.740330 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] For port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=43066bfd-26eb-4a35-9f53-02e9ff2e6c84,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:55:57.745329 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.852825 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Routers {'728e739d-afec-42c9-b7f9-65837b18602c'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:55:57.853470 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:55:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['728e739d-afec-42c9-b7f9-65837b18602c'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:55:57.861507 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:55:57.874035 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Sync routers for ids ['4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:55:57.884860 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] Publish callbacks [] for router, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:57.886827 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-ca4a2440-f85b-4e96-865f-8dee16a3bf52 admin admin] 10.222.0.46 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.6635752 Dec 20 05:55:57.889915 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46112) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:55:57.892339 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Routers {'4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:55:57.893466 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:55:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:55:57.924511 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa267681-cbfb-4a90-a847-7230156d9c32 None None] Pushing event updated for resources: {'Port': ['ID=43066bfd-26eb-4a35-9f53-02e9ff2e6c84,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:58.018628 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Provisioning complete for port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:58.018996 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:58.089319 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] Set router 728e739d-afec-42c9-b7f9-65837b18602c gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:55:58.117309 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 973d22fc-4c72-4242-98d2-520773fe8892 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:55:58.204900 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Set router 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:55:58.315363 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:58.317146 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 973d22fc-4c72-4242-98d2-520773fe8892 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:58.317506 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:58.416275 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] For port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=43066bfd-26eb-4a35-9f53-02e9ff2e6c84,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:58.425383 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'name': 'tempest-TestShelveInstance-955066821-router', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.153'}], 'enable_snat': True}, 'gw_port_id': '296558c0-da9a-41e2-8d59-d859119282bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T05:55:57Z', 'revision_number': 3, 'project_id': 'd82dce4bc31c44f380b140b751dacc3c', 'gw_port': {'id': '296558c0-da9a-41e2-8d59-d859119282bb', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:24:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T05:55:56Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:55:58.426883 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:58.462374 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Checking router: 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:55:58.462725 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Updating router 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb port 296558c0-da9a-41e2-8d59-d859119282bb binding host dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:55:58.473548 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da0162c1-cbac-4a0a-acc7-22e22190f481 req-e52a6508-352d-485e-8bbb-8c6e61be8989 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:58.483066 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-da0162c1-cbac-4a0a-acc7-22e22190f481 req-e52a6508-352d-485e-8bbb-8c6e61be8989 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0774305 Dec 20 05:55:58.520454 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:58.551933 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-da0162c1-cbac-4a0a-acc7-22e22190f481 req-de0403d0-4818-491a-a62b-b60b9a48a86a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676420 Dec 20 05:55:58.566237 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Pushing event updated for resources: {'Port': ['ID=43066bfd-26eb-4a35-9f53-02e9ff2e6c84,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:58.571119 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 4db19e9b-aab1-4e70-bdfc-44279e419cf3 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:55:58.580530 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28'}], 'enable_snat': True}, 'gw_port_id': '973d22fc-4c72-4242-98d2-520773fe8892', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:53Z', 'revision_number': 4, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port': {'id': '973d22fc-4c72-4242-98d2-520773fe8892', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:1e:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '43066bfd-26eb-4a35-9f53-02e9ff2e6c84', 'name': '', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'mac_address': 'fa:16:3e:6c:72:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:53Z', 'updated_at': '2021-12-20T05:55:57Z', 'revision_number': 4, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'subnets': [{'id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:55:58.622174 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:58.622547 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:58.622910 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:58.623252 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:58.623619 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:58.623955 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:58.624945 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:58.625280 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:58.625611 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:58.625978 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:58.626323 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:58.627092 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:58.627092 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b5c513-fd05-4cb0-9338-f64dc4178f19 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:58.669431 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb3b6b95-0b23-4a54-aabe-a6a0305153f6 None None] The sync data for ids ['728e739d-afec-42c9-b7f9-65837b18602c'] in dv-cinder-822278-1-iscsi is: [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28'}], 'enable_snat': True}, 'gw_port_id': '973d22fc-4c72-4242-98d2-520773fe8892', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:53Z', 'revision_number': 4, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port': {'id': '973d22fc-4c72-4242-98d2-520773fe8892', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:1e:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '43066bfd-26eb-4a35-9f53-02e9ff2e6c84', 'name': '', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'mac_address': 'fa:16:3e:6c:72:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:53Z', 'updated_at': '2021-12-20T05:55:57Z', 'revision_number': 4, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'subnets': [{'id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:55:58.678567 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-b4f989aa-03f7-4f31-8758-48f28bcc1e14 None None] Provisioning complete for port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:58.679014 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-b4f989aa-03f7-4f31-8758-48f28bcc1e14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:58.816840 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 4db19e9b-aab1-4e70-bdfc-44279e419cf3 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:58.817479 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:58.851846 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:58.947725 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Publish callbacks [] for port, precommit_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:58.954652 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:58.959295 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:59.003799 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port 4db19e9b-aab1-4e70-bdfc-44279e419cf3, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=4db19e9b-aab1-4e70-bdfc-44279e419cf3,segment=NetworkSegment(7b70b34f-119b-467b-94c2-17c9cbdbee98),segment_id=7b70b34f-119b-467b-94c2-17c9cbdbee98)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:55:59.012650 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:59.024711 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Attempting to bind port 296558c0-da9a-41e2-8d59-d859119282bb on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:55:59.026684 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Attempting to bind port 296558c0-da9a-41e2-8d59-d859119282bb by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:55:59.027271 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Attempting to bind port 296558c0-da9a-41e2-8d59-d859119282bb on network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:55:59.040300 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Allocated IP 172.20.0.1 (3527cc32-eb9d-47f1-86ed-ee56f32f9073/d3c4b4eb-e61a-4c53-8658-913dc8e3c2fe/7b9699de-1644-4440-8d8c-0bf685972943) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:55:59.041303 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 55, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:55:59.042261 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Checking segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102448) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:55:59.042651 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:59.043040 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Bound using segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:55:59.043505 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Bound port: 296558c0-da9a-41e2-8d59-d859119282bb, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:55:59.043996 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:59.045581 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Pushing event updated for resources: {'Port': ['ID=296558c0-da9a-41e2-8d59-d859119282bb,revision_number=2']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:59.059497 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b2f8769-7ba6-4a92-930f-645c89898295 None None] Network 3527cc32-eb9d-47f1-86ed-ee56f32f9073 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:55:59.073036 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:59.073656 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:59.074199 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:59.074687 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:59.075169 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:59.075683 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:59.076181 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:59.076680 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:59.077191 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:59.077537 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:59.077870 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:59.078191 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:59.078511 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:55:59.124523 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] For port 296558c0-da9a-41e2-8d59-d859119282bb, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102448) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:55:59.130506 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] For port 296558c0-da9a-41e2-8d59-d859119282bb, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=296558c0-da9a-41e2-8d59-d859119282bb,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102448) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:55:59.136378 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:59.176324 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-29612d2f-acd5-4269-93f0-4d11ef37409d None None] Provisioning complete for port 4db19e9b-aab1-4e70-bdfc-44279e419cf3 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:59.176706 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-29612d2f-acd5-4269-93f0-4d11ef37409d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:59.178978 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:59.206745 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef0800c-671b-4ed2-a1ac-f8df1f882d95 None None] Pushing event updated for resources: {'Port': ['ID=296558c0-da9a-41e2-8d59-d859119282bb,revision_number=3']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:59.217750 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Routers {'4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:55:59.218658 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:55:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:55:59.226659 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:59.270011 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Network 3527cc32-eb9d-47f1-86ed-ee56f32f9073 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:55:59.276394 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:55:59.280169 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:55:59.312176 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Pushing event updated for resources: {'Port': ['ID=7b9699de-1644-4440-8d8c-0bf685972943,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:59.343115 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1703675'] for router_interface, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:59.369330 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=4db19e9b-aab1-4e70-bdfc-44279e419cf3,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:55:59.392318 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] Set router 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:55:59.530846 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:59.646677 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'name': 'tempest-TestShelveInstance-955066821-router', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.153'}], 'enable_snat': True}, 'gw_port_id': '296558c0-da9a-41e2-8d59-d859119282bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T05:55:57Z', 'revision_number': 3, 'project_id': 'd82dce4bc31c44f380b140b751dacc3c', 'gw_port': {'id': '296558c0-da9a-41e2-8d59-d859119282bb', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:24:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T05:55:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:55:59.681380 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b74360e1-5487-4080-b2de-3daa2b0d4577 None None] The sync data for ids ['4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'] in dv-cinder-822278-1-iscsi is: [{'id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'name': 'tempest-TestShelveInstance-955066821-router', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.153'}], 'enable_snat': True}, 'gw_port_id': '296558c0-da9a-41e2-8d59-d859119282bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T05:55:57Z', 'revision_number': 3, 'project_id': 'd82dce4bc31c44f380b140b751dacc3c', 'gw_port': {'id': '296558c0-da9a-41e2-8d59-d859119282bb', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:24:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T05:55:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:55:59.739861 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aad5b823-a667-4c12-a18f-4647c878a2eb req-9ae17434-8b36-44ac-bb39-49d829213991 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:55:59.744035 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-aad5b823-a667-4c12-a18f-4647c878a2eb req-9ae17434-8b36-44ac-bb39-49d829213991 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.1025872 Dec 20 05:55:59.795635 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:59.801617 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:59.832191 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-f6c9e4cf-84f0-48fa-a610-bce026f2dbfd None None] Provisioning complete for port 4db19e9b-aab1-4e70-bdfc-44279e419cf3 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:55:59.833356 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f6c9e4cf-84f0-48fa-a610-bce026f2dbfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:59.834455 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-aad5b823-a667-4c12-a18f-4647c878a2eb req-15c6caf0-b75b-4fe8-b4dd-cafe1bb1f972 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0858958 Dec 20 05:55:59.885158 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1617520', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1697131'] for router_interface, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:55:59.952687 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Pushing event updated for resources: {'Port': ['ID=7b9699de-1644-4440-8d8c-0bf685972943,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:00.029034 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-f6c9e4cf-84f0-48fa-a610-bce026f2dbfd None None] Provisioning complete for port 7b9699de-1644-4440-8d8c-0bf685972943 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:00.029409 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f6c9e4cf-84f0-48fa-a610-bce026f2dbfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:00.058156 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:00.059248 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Network 3527cc32-eb9d-47f1-86ed-ee56f32f9073 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:56:00.060990 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:00.129103 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-f6c9e4cf-84f0-48fa-a610-bce026f2dbfd None None] Port 7b9699de-1644-4440-8d8c-0bf685972943 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:56:00.149990 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:00.151905 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:00.260592 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Router 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:56:00.297275 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-03c5bbbd-fbe3-40ed-a1ba-d7cebba334ec None None] Provisioning complete for port 7b9699de-1644-4440-8d8c-0bf685972943 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:00.297647 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-03c5bbbd-fbe3-40ed-a1ba-d7cebba334ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:00.300130 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 4db19e9b-aab1-4e70-bdfc-44279e419cf3 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:00.378021 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-03c5bbbd-fbe3-40ed-a1ba-d7cebba334ec None None] Port 7b9699de-1644-4440-8d8c-0bf685972943 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:56:00.381425 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 4db19e9b-aab1-4e70-bdfc-44279e419cf3 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:00.381796 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:00.420341 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:56:00.427231 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-0d20b3c2-6846-415c-9f02-48124a4b7d9a admin admin] 10.222.0.46 "PUT /v2.0/routers/4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5359087 Dec 20 05:56:00.507588 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-4d5c15ac-9d21-485e-bc5d-dd0e5af9c708 None None] Provisioning complete for port 7b9699de-1644-4440-8d8c-0bf685972943 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:00.507969 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-4d5c15ac-9d21-485e-bc5d-dd0e5af9c708 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:00.543276 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-4d5c15ac-9d21-485e-bc5d-dd0e5af9c708 None None] Port 7b9699de-1644-4440-8d8c-0bf685972943 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:56:00.703295 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 75f0ad55-bd12-4474-9eb7-d4482ab761b1 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:56:00.734565 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: 75f0ad55-bd12-4474-9eb7-d4482ab761b1 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:56:00.734924 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 75f0ad55-bd12-4474-9eb7-d4482ab761b1 not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:56:00.951017 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab233a64-7792-433f-b894-b07d1ac865ac req-9bd28d7d-48e8-4248-8510-9de11bb873de tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:00.952553 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ab233a64-7792-433f-b894-b07d1ac865ac req-9bd28d7d-48e8-4248-8510-9de11bb873de tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0504882 Dec 20 05:56:01.002527 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ab233a64-7792-433f-b894-b07d1ac865ac req-ab6fdb07-5e35-46e2-9bc6-6e3e17a5a45b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434225 Dec 20 05:56:01.105628 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46146) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:01.110195 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-e33dcee0-7963-457c-927a-e4ba433722fa tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1384921729', 'description': 'tempest-secgroup-smoke-1384921729 description', 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:01.135613 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e33dcee0-7963-457c-927a-e4ba433722fa tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.208148 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e33dcee0-7963-457c-927a-e4ba433722fa tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.211763 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e33dcee0-7963-457c-927a-e4ba433722fa tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.242314 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e33dcee0-7963-457c-927a-e4ba433722fa tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.243552 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-e33dcee0-7963-457c-927a-e4ba433722fa tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1369007 Dec 20 05:56:01.245251 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e33dcee0-7963-457c-927a-e4ba433722fa tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0ee7077b-2ff5-4a83-bf29-d30984dea2c7,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:01.247255 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 46148) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:01.251973 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-6590ad3b-bead-4362-9863-c5bcb26b85ae tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Request body: {'security_group_rule': {'security_group_id': '0ee7077b-2ff5-4a83-bf29-d30984dea2c7', 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:01.281180 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-6590ad3b-bead-4362-9863-c5bcb26b85ae tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.333970 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-6590ad3b-bead-4362-9863-c5bcb26b85ae tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.337919 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-6590ad3b-bead-4362-9863-c5bcb26b85ae tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.356290 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6590ad3b-bead-4362-9863-c5bcb26b85ae tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=64228d11-d0a4-411a-992c-c80cda15ab1c,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:01.363241 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-6590ad3b-bead-4362-9863-c5bcb26b85ae tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.364399 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-6590ad3b-bead-4362-9863-c5bcb26b85ae tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1159856 Dec 20 05:56:01.367094 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 46150) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:01.371337 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-3474d878-3fff-4374-8647-d871de032e16 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Request body: {'security_group_rule': {'security_group_id': '0ee7077b-2ff5-4a83-bf29-d30984dea2c7', 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:01.398183 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3474d878-3fff-4374-8647-d871de032e16 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.453437 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3474d878-3fff-4374-8647-d871de032e16 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.457679 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3474d878-3fff-4374-8647-d871de032e16 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.475250 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3474d878-3fff-4374-8647-d871de032e16 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=70c1df19-4098-46b7-8b33-ffe399ebc8f1,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:01.484087 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3474d878-3fff-4374-8647-d871de032e16 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.485267 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-3474d878-3fff-4374-8647-d871de032e16 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1171975 Dec 20 05:56:01.487854 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 46156) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:01.491947 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-4eab2bb5-b22e-4959-a788-11acc3c82f12 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Request body: {'security_group_rule': {'security_group_id': '0ee7077b-2ff5-4a83-bf29-d30984dea2c7', 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:01.518815 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4eab2bb5-b22e-4959-a788-11acc3c82f12 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.582027 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4eab2bb5-b22e-4959-a788-11acc3c82f12 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.585793 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4eab2bb5-b22e-4959-a788-11acc3c82f12 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.602693 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eab2bb5-b22e-4959-a788-11acc3c82f12 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1496b3e8-88a9-4462-a78c-4ae290ed834c,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:01.612478 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4eab2bb5-b22e-4959-a788-11acc3c82f12 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.613650 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-4eab2bb5-b22e-4959-a788-11acc3c82f12 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1248963 Dec 20 05:56:01.616185 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 46158) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:01.620345 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-ba79c55a-ba40-4235-9031-7531949c3c0a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Request body: {'security_group_rule': {'security_group_id': '0ee7077b-2ff5-4a83-bf29-d30984dea2c7', 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:01.647747 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ba79c55a-ba40-4235-9031-7531949c3c0a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.710043 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ba79c55a-ba40-4235-9031-7531949c3c0a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.716821 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ba79c55a-ba40-4235-9031-7531949c3c0a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.720494 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-924a1759-f74a-42b0-a3de-7893fbabd498 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.734760 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba79c55a-ba40-4235-9031-7531949c3c0a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=36e751d9-a76a-4679-aa4e-c0f96da97dea,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:01.743849 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ba79c55a-ba40-4235-9031-7531949c3c0a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.745105 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-ba79c55a-ba40-4235-9031-7531949c3c0a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1279852 Dec 20 05:56:01.747823 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 46160) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:01.752486 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-13b79e73-e5b5-4994-bf5b-4858aba7364a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Request body: {'security_group_rule': {'security_group_id': '0ee7077b-2ff5-4a83-bf29-d30984dea2c7', 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:01.777683 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.securitygroups_db [None req-13b79e73-e5b5-4994-bf5b-4858aba7364a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Project a67a7ba727e54b1c9f6ca2d5ea21f272 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 20 05:56:01.782743 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-13b79e73-e5b5-4994-bf5b-4858aba7364a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.844518 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-13b79e73-e5b5-4994-bf5b-4858aba7364a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.848573 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-13b79e73-e5b5-4994-bf5b-4858aba7364a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.867872 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13b79e73-e5b5-4994-bf5b-4858aba7364a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b3eb5615-9201-416e-9c11-2934a331d441,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:01.874401 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-13b79e73-e5b5-4994-bf5b-4858aba7364a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.874724 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 296558c0-da9a-41e2-8d59-d859119282bb up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:01.878729 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-13b79e73-e5b5-4994-bf5b-4858aba7364a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1267657 Dec 20 05:56:01.878729 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 46164) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:01.884202 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-87b2b407-440e-413c-8a6d-d662032170b5 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Request body: {'security_group_rule': {'security_group_id': '0ee7077b-2ff5-4a83-bf29-d30984dea2c7', 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:01.909061 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.securitygroups_db [None req-87b2b407-440e-413c-8a6d-d662032170b5 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Project a67a7ba727e54b1c9f6ca2d5ea21f272 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 20 05:56:01.913912 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-87b2b407-440e-413c-8a6d-d662032170b5 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.928040 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 296558c0-da9a-41e2-8d59-d859119282bb triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:01.928472 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.981883 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-87b2b407-440e-413c-8a6d-d662032170b5 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:01.986606 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-87b2b407-440e-413c-8a6d-d662032170b5 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:02.006246 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87b2b407-440e-413c-8a6d-d662032170b5 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c8aa4f22-9b62-41d4-bac0-ff6bd16928f0,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:02.008878 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:02.012114 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-87b2b407-440e-413c-8a6d-d662032170b5 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:02.015901 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-87b2b407-440e-413c-8a6d-d662032170b5 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1331968 Dec 20 05:56:02.037889 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port 296558c0-da9a-41e2-8d59-d859119282bb, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=296558c0-da9a-41e2-8d59-d859119282bb,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:56:02.043432 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:02.083871 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Sync routers for ids ['4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:56:02.102519 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Routers {'4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:56:02.103192 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:55:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:02.138355 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d12491e2-43c6-43ed-a6cf-c656a56aaf56 req-d7b4ffd5-187f-4032-8a7f-546c87e35b4e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:02.139974 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d12491e2-43c6-43ed-a6cf-c656a56aaf56 req-d7b4ffd5-187f-4032-8a7f-546c87e35b4e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0593488 Dec 20 05:56:02.163245 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=296558c0-da9a-41e2-8d59-d859119282bb,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:02.193122 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d12491e2-43c6-43ed-a6cf-c656a56aaf56 req-5e44568f-6288-42e3-a45a-25f9face0cb3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459213 Dec 20 05:56:02.238989 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Set router 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:56:02.479579 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'name': 'tempest-TestShelveInstance-955066821-router', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.153'}], 'enable_snat': True}, 'gw_port_id': '296558c0-da9a-41e2-8d59-d859119282bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T05:55:59Z', 'revision_number': 4, 'project_id': 'd82dce4bc31c44f380b140b751dacc3c', 'gw_port': {'id': '296558c0-da9a-41e2-8d59-d859119282bb', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:24:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T05:56:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '7b9699de-1644-4440-8d8c-0bf685972943', 'name': '', 'network_id': '3527cc32-eb9d-47f1-86ed-ee56f32f9073', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c', 'mac_address': 'fa:16:3e:8f:10:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'device_owner': 'network:router_interface', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'd3c4b4eb-e61a-4c53-8658-913dc8e3c2fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:58Z', 'updated_at': '2021-12-20T05:55:59Z', 'revision_number': 2, 'project_id': 'd82dce4bc31c44f380b140b751dacc3c', 'subnets': [{'id': 'd3c4b4eb-e61a-4c53-8658-913dc8e3c2fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:02.515175 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Checking router: 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:56:02.515557 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Updating router 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb port 7b9699de-1644-4440-8d8c-0bf685972943 binding host dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:56:02.551123 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:02.854400 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Publish callbacks [] for port, precommit_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:02.861365 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:02.996667 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f3fc89f-9598-4736-af79-24e374d5cbf0 None None] Pushing event updated for resources: {'Port': ['ID=7b9699de-1644-4440-8d8c-0bf685972943,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:03.021675 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Attempting to bind port 7b9699de-1644-4440-8d8c-0bf685972943 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:56:03.021675 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Attempting to bind port 7b9699de-1644-4440-8d8c-0bf685972943 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '7b70b34f-119b-467b-94c2-17c9cbdbee98', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': '3527cc32-eb9d-47f1-86ed-ee56f32f9073'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:56:03.021675 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Attempting to bind port 7b9699de-1644-4440-8d8c-0bf685972943 on network 3527cc32-eb9d-47f1-86ed-ee56f32f9073 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:56:03.021675 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 55, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:56:03.022437 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Checking segment: {'id': '7b70b34f-119b-467b-94c2-17c9cbdbee98', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': '3527cc32-eb9d-47f1-86ed-ee56f32f9073'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:56:03.022717 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:03.023282 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Bound using segment: {'id': '7b70b34f-119b-467b-94c2-17c9cbdbee98', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': '3527cc32-eb9d-47f1-86ed-ee56f32f9073'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:56:03.024231 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Bound port: 7b9699de-1644-4440-8d8c-0bf685972943, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7b70b34f-119b-467b-94c2-17c9cbdbee98', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': '3527cc32-eb9d-47f1-86ed-ee56f32f9073'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:56:03.024629 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:03.128879 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] For port 7b9699de-1644-4440-8d8c-0bf685972943, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:56:03.134769 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] For port 7b9699de-1644-4440-8d8c-0bf685972943, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=7b9699de-1644-4440-8d8c-0bf685972943,segment=NetworkSegment(7b70b34f-119b-467b-94c2-17c9cbdbee98),segment_id=7b70b34f-119b-467b-94c2-17c9cbdbee98)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:56:03.143592 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:03.294513 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Routers {'4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:56:03.295025 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:55:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:03.314291 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f3fc89f-9598-4736-af79-24e374d5cbf0 None None] Pushing event updated for resources: {'Port': ['ID=7b9699de-1644-4440-8d8c-0bf685972943,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:03.373213 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d34ecbb-5c78-4a6a-aafb-205fcd1968b2 req-ebed1668-8aea-4cce-84a1-dd66777d3003 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:03.383049 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7d34ecbb-5c78-4a6a-aafb-205fcd1968b2 req-ebed1668-8aea-4cce-84a1-dd66777d3003 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0907078 Dec 20 05:56:03.474630 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-140fc13c-72b4-4068-9402-7cfc6c603d08 None None] Provisioning complete for port 7b9699de-1644-4440-8d8c-0bf685972943 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:03.475237 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-140fc13c-72b4-4068-9402-7cfc6c603d08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:03.495347 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7d34ecbb-5c78-4a6a-aafb-205fcd1968b2 req-bc63c29b-f5a7-4557-996c-b5659e9ee467 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1085799 Dec 20 05:56:03.644757 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] Set router 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:56:03.762502 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-140fc13c-72b4-4068-9402-7cfc6c603d08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:03.823100 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-140fc13c-72b4-4068-9402-7cfc6c603d08 None None] For port 7b9699de-1644-4440-8d8c-0bf685972943, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=7b9699de-1644-4440-8d8c-0bf685972943,segment=NetworkSegment(7b70b34f-119b-467b-94c2-17c9cbdbee98),segment_id=7b70b34f-119b-467b-94c2-17c9cbdbee98)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:56:03.831182 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-140fc13c-72b4-4068-9402-7cfc6c603d08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:03.892604 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 296558c0-da9a-41e2-8d59-d859119282bb up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:04.059346 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed2b9fdc-9322-43da-856c-1cbc609a204e req-5200944c-1d30-4e8b-a27a-b4272f1d03a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:04.060937 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ed2b9fdc-9322-43da-856c-1cbc609a204e req-5200944c-1d30-4e8b-a27a-b4272f1d03a7 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 1098 time: 0.0437891 Dec 20 05:56:04.119160 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ed2b9fdc-9322-43da-856c-1cbc609a204e req-8b753193-8dca-4cd8-b9a4-3dd76e9d01d2 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456100 Dec 20 05:56:04.142252 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-f20de27b-ede0-4bb4-8396-fbf4c49bb4ed None None] Provisioning complete for port 7b9699de-1644-4440-8d8c-0bf685972943 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:04.142643 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f20de27b-ede0-4bb4-8396-fbf4c49bb4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:04.173249 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-140fc13c-72b4-4068-9402-7cfc6c603d08 None None] Pushing event updated for resources: {'Port': ['ID=7b9699de-1644-4440-8d8c-0bf685972943,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:04.266127 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ee7950a3-8caa-4689-b0c2-ebc259326ee1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:04.268553 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 296558c0-da9a-41e2-8d59-d859119282bb triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:04.268924 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:04.374129 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'name': 'tempest-TestShelveInstance-955066821-router', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.153'}], 'enable_snat': True}, 'gw_port_id': '296558c0-da9a-41e2-8d59-d859119282bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T05:55:59Z', 'revision_number': 4, 'project_id': 'd82dce4bc31c44f380b140b751dacc3c', 'gw_port': {'id': '296558c0-da9a-41e2-8d59-d859119282bb', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:24:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T05:56:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '7b9699de-1644-4440-8d8c-0bf685972943', 'name': '', 'network_id': '3527cc32-eb9d-47f1-86ed-ee56f32f9073', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c', 'mac_address': 'fa:16:3e:8f:10:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'device_owner': 'network:router_interface', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'd3c4b4eb-e61a-4c53-8658-913dc8e3c2fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:58Z', 'updated_at': '2021-12-20T05:56:03Z', 'revision_number': 4, 'project_id': 'd82dce4bc31c44f380b140b751dacc3c', 'subnets': [{'id': 'd3c4b4eb-e61a-4c53-8658-913dc8e3c2fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:04.429427 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08aa05da-a9ac-439a-9dce-3b392f427244 None None] The sync data for ids ['4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'] in dv-cinder-822278-1-iscsi is: [{'id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'name': 'tempest-TestShelveInstance-955066821-router', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.153'}], 'enable_snat': True}, 'gw_port_id': '296558c0-da9a-41e2-8d59-d859119282bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T05:55:59Z', 'revision_number': 4, 'project_id': 'd82dce4bc31c44f380b140b751dacc3c', 'gw_port': {'id': '296558c0-da9a-41e2-8d59-d859119282bb', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:24:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T05:56:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '7b9699de-1644-4440-8d8c-0bf685972943', 'name': '', 'network_id': '3527cc32-eb9d-47f1-86ed-ee56f32f9073', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c', 'mac_address': 'fa:16:3e:8f:10:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'device_owner': 'network:router_interface', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'd3c4b4eb-e61a-4c53-8658-913dc8e3c2fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:58Z', 'updated_at': '2021-12-20T05:56:03Z', 'revision_number': 4, 'project_id': 'd82dce4bc31c44f380b140b751dacc3c', 'subnets': [{'id': 'd3c4b4eb-e61a-4c53-8658-913dc8e3c2fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:56:04.646359 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b42513d-1222-4424-9d49-761ac8f3af90 req-cf8cd35e-c5a5-4e11-bef7-75988e5ca962 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:04.648031 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6b42513d-1222-4424-9d49-761ac8f3af90 req-cf8cd35e-c5a5-4e11-bef7-75988e5ca962 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0580983 Dec 20 05:56:04.735323 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6b42513d-1222-4424-9d49-761ac8f3af90 req-f54e8270-38b0-47c7-8f55-9c3b78ae7d40 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0781963 Dec 20 05:56:04.978652 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:05.948854 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 7b9699de-1644-4440-8d8c-0bf685972943 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:05.953878 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b98ccf4c-15c2-4227-955d-5fa4f0c60358 req-fad3d06e-48fe-41eb-a18b-170a6f7f3dc1 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:05.966627 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b98ccf4c-15c2-4227-955d-5fa4f0c60358 req-fad3d06e-48fe-41eb-a18b-170a6f7f3dc1 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.1209648 Dec 20 05:56:06.037679 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 7b9699de-1644-4440-8d8c-0bf685972943 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:06.038189 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:06.077310 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b98ccf4c-15c2-4227-955d-5fa4f0c60358 req-d676086a-24f1-487c-a32e-14c449b65ae9 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1082578 Dec 20 05:56:06.261620 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9f5cef9-4f45-4029-aed6-ad01c3cd52b0 req-50a59f3a-0b4d-4a84-8322-7624b3feeabc tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:06.263182 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d9f5cef9-4f45-4029-aed6-ad01c3cd52b0 req-50a59f3a-0b4d-4a84-8322-7624b3feeabc tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0639863 Dec 20 05:56:06.310441 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d9f5cef9-4f45-4029-aed6-ad01c3cd52b0 req-54add65e-5ad7-45e3-94fa-6a2e5e867ebe tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408428 Dec 20 05:56:06.470467 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:07.344970 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:07.574276 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:08.043208 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f7ac4ef-f918-4104-b34b-94e73a0fa410 req-4999afe7-46e0-4a08-904b-cba8a6417215 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:08.045674 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8f7ac4ef-f918-4104-b34b-94e73a0fa410 req-4999afe7-46e0-4a08-904b-cba8a6417215 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0998566 Dec 20 05:56:08.048753 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5298e8f4-3731-4ea6-9961-0389fbb356d4 req-532535ef-5a90-434f-b8a8-a8991a0cfc1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:08.053343 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5298e8f4-3731-4ea6-9961-0389fbb356d4 req-532535ef-5a90-434f-b8a8-a8991a0cfc1c service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a2e9de0d64e642f08bf90d402e77baa3&device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 1098 time: 0.0934324 Dec 20 05:56:08.159747 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8f7ac4ef-f918-4104-b34b-94e73a0fa410 req-f6917e7d-6e36-4795-9f88-e076a5ec2bf6 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1053538 Dec 20 05:56:08.187810 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5298e8f4-3731-4ea6-9961-0389fbb356d4 req-c99fe3ce-45b9-42b5-b86f-496e60c6d878 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:08.190184 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5298e8f4-3731-4ea6-9961-0389fbb356d4 req-c99fe3ce-45b9-42b5-b86f-496e60c6d878 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a HTTP/1.1" status: 200 len: 920 time: 0.1191926 Dec 20 05:56:08.247389 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5298e8f4-3731-4ea6-9961-0389fbb356d4 req-8c8b4ba6-92c7-4de2-bccf-56391ee1f961 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 HTTP/1.1" status: 200 len: 217 time: 0.0498722 Dec 20 05:56:08.307916 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5298e8f4-3731-4ea6-9961-0389fbb356d4 req-645276b7-66c9-47f8-a732-a7c6dc8e073d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:08.309572 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5298e8f4-3731-4ea6-9961-0389fbb356d4 req-645276b7-66c9-47f8-a732-a7c6dc8e073d service neutron] 10.222.0.54 "GET /v2.0/subnets?id=e1658c3d-4c2e-4687-a529-637456d3a81c HTTP/1.1" status: 200 len: 859 time: 0.0537817 Dec 20 05:56:08.345925 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5298e8f4-3731-4ea6-9961-0389fbb356d4 req-1b59d3c7-77e1-477b-ae88-3635b09d8789 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0273263 Dec 20 05:56:08.469090 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5298e8f4-3731-4ea6-9961-0389fbb356d4 req-40280da8-8806-474c-a9b6-df18d8cf9467 service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1113777 Dec 20 05:56:08.622988 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5298e8f4-3731-4ea6-9961-0389fbb356d4 req-4b4998fa-3947-408c-bd99-5ba8ac9cb988 service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1388581 Dec 20 05:56:08.791939 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46322) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:08.957002 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-acdfe9c6-f650-4c08-880f-a935761ce938 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:09.054644 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-acdfe9c6-f650-4c08-880f-a935761ce938 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:09.060611 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-acdfe9c6-f650-4c08-880f-a935761ce938 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:09.117488 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acdfe9c6-f650-4c08-880f-a935761ce938 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9c750db0-79b7-4ed3-9914-82773f1f50ce,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:09.123765 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-acdfe9c6-f650-4c08-880f-a935761ce938 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=dfa9f7313e4a4068adaab7f2733ac3dd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3307357 Dec 20 05:56:09.127343 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 46332) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:09.185034 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-7af2951b-2628-439c-b1c1-578303b679c1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:09.212903 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-7af2951b-2628-439c-b1c1-578303b679c1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:09.311225 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-455ad16e-42cb-4848-a960-5aae3a8d3a3c req-ab54a77f-2386-45b8-8a67-208f1c7306dc tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:09.312855 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-455ad16e-42cb-4848-a960-5aae3a8d3a3c req-ab54a77f-2386-45b8-8a67-208f1c7306dc tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0727627 Dec 20 05:56:09.336729 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-7af2951b-2628-439c-b1c1-578303b679c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:09.339595 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-7af2951b-2628-439c-b1c1-578303b679c1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:09.340774 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-7af2951b-2628-439c-b1c1-578303b679c1 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/9c750db0-79b7-4ed3-9914-82773f1f50ce HTTP/1.1" status: 204 len: 168 time: 0.2126698 Dec 20 05:56:09.355467 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7af2951b-2628-439c-b1c1-578303b679c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c750db0-79b7-4ed3-9914-82773f1f50ce,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:09.383873 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-455ad16e-42cb-4848-a960-5aae3a8d3a3c req-a8375323-5095-495d-b1d3-b01428b38bd8 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0601945 Dec 20 05:56:10.117699 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 46358) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:10.223716 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-132925027-network', 'tenant_id': 'a0ce0dc0b4da4cb093e9599f5cddd0c9'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:10.251202 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] Made reservation on behalf of a0ce0dc0b4da4cb093e9599f5cddd0c9 for: {'network': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:56:10.253487 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:10.262494 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:10.346484 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:10.351148 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:10.380897 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] vlan segment allocate from pool success with {'vlan_id': 418, 'physical_network': 'physnet1'} {{(pid=102445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:56:10.398542 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86dd8038-82cb-4fbf-954a-3aaaf1887354,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:10.402821 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:10.403351 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.segments_db [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] Added segment 62bdd930-d981-4fed-ad58-9d410d5c0393 of type vlan for network 9da693b1-1216-4020-9114-46c9936e8a72 Dec 20 05:56:10.453690 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:10.512211 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:10.513378 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:10.513980 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:10.571681 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.4525695 Dec 20 05:56:10.574604 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46364) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:10.580612 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-65a4c17c-1671-48c9-a5e1-6a91b20ffc60 admin admin] Request body: {'subnet': {'network_id': '9da693b1-1216-4020-9114-46c9936e8a72', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-132925027-subnet', 'tenant_id': 'a0ce0dc0b4da4cb093e9599f5cddd0c9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:10.608190 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-65a4c17c-1671-48c9-a5e1-6a91b20ffc60 admin admin] Made reservation on behalf of a0ce0dc0b4da4cb093e9599f5cddd0c9 for: {'subnet': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:56:10.611882 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-65a4c17c-1671-48c9-a5e1-6a91b20ffc60 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3270951'] for subnet, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:10.621406 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddca1986-08d4-4076-b53e-0d46410a8afe req-a99eaf0e-c541-4931-9edf-39c73115c8ae tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:10.622952 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ddca1986-08d4-4076-b53e-0d46410a8afe req-a99eaf0e-c541-4931-9edf-39c73115c8ae tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.1478868 Dec 20 05:56:10.623786 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-151f1823-102c-4506-b69a-1d1a951013e6 admin admin] Pushing event updated for resources: {'Network': ['ID=9da693b1-1216-4020-9114-46c9936e8a72,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:10.638478 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network 9da693b1-1216-4020-9114-46c9936e8a72 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:56:10.687550 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ddca1986-08d4-4076-b53e-0d46410a8afe req-e290a8bd-d496-4087-a90a-582e7c2024bb tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575001 Dec 20 05:56:10.825010 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-65a4c17c-1671-48c9-a5e1-6a91b20ffc60 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9168037', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3270985'] for subnet, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:10.893259 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65a4c17c-1671-48c9-a5e1-6a91b20ffc60 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8265e939-4727-4318-be2f-9d57754a238e,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:10.903654 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65a4c17c-1671-48c9-a5e1-6a91b20ffc60 admin admin] Checking segment: {'id': '62bdd930-d981-4fed-ad58-9d410d5c0393', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 418, 'network_id': '9da693b1-1216-4020-9114-46c9936e8a72'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:56:10.904058 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65a4c17c-1671-48c9-a5e1-6a91b20ffc60 admin admin] Network hostable DHCP agents. Network: 9da693b1-1216-4020-9114-46c9936e8a72, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102446) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:56:10.929473 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65a4c17c-1671-48c9-a5e1-6a91b20ffc60 admin admin] Network 9da693b1-1216-4020-9114-46c9936e8a72 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102446) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:56:10.941072 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-65a4c17c-1671-48c9-a5e1-6a91b20ffc60 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, 9da693b1-1216-4020-9114-46c9936e8a72) {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:10.950468 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65a4c17c-1671-48c9-a5e1-6a91b20ffc60 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:10.950631 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15e03d9d-342a-4d6a-bfae-726f8db15c92 None None] Network 9da693b1-1216-4020-9114-46c9936e8a72 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:56:10.951872 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-65a4c17c-1671-48c9-a5e1-6a91b20ffc60 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:10.974955 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-65a4c17c-1671-48c9-a5e1-6a91b20ffc60 admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3987510 Dec 20 05:56:11.098230 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9935d25-3811-4581-ba9d-4f7e1ec80759 None None] Network 9da693b1-1216-4020-9114-46c9936e8a72 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:56:11.810180 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d1db70c-561b-4f48-88a2-ebd3048c900c req-e4806624-47c1-4492-b9cd-acf1bc277884 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:11.811764 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3d1db70c-561b-4f48-88a2-ebd3048c900c req-e4806624-47c1-4492-b9cd-acf1bc277884 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0479636 Dec 20 05:56:11.857567 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3d1db70c-561b-4f48-88a2-ebd3048c900c req-af5c1519-fbe1-4ae8-adea-9fc0e8a06e75 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399759 Dec 20 05:56:13.003730 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26bb810-6f01-49ba-a145-5cc400186ae4 req-c772af64-0d2c-405a-bf95-74031aceaf62 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:13.005376 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d26bb810-6f01-49ba-a145-5cc400186ae4 req-c772af64-0d2c-405a-bf95-74031aceaf62 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0715420 Dec 20 05:56:13.061528 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d26bb810-6f01-49ba-a145-5cc400186ae4 req-bcd0e9c4-a0a8-4227-a4f1-6c42e320ad6e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491440 Dec 20 05:56:14.185123 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dec05a5-46d0-4808-8fb7-d4c0156f1a21 req-4fbd2e11-3d0d-4aaa-a44f-49eadc815efc tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:14.186974 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8dec05a5-46d0-4808-8fb7-d4c0156f1a21 req-4fbd2e11-3d0d-4aaa-a44f-49eadc815efc tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0530572 Dec 20 05:56:14.240047 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8dec05a5-46d0-4808-8fb7-d4c0156f1a21 req-29caa2ff-2aab-405e-a294-b4d57f83a965 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459812 Dec 20 05:56:15.363785 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a13b1d1-970c-4098-90d4-536855330c33 req-b40257e7-baf1-40b1-b3bf-6a07ab4b2c25 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:15.365356 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6a13b1d1-970c-4098-90d4-536855330c33 req-b40257e7-baf1-40b1-b3bf-6a07ab4b2c25 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0515532 Dec 20 05:56:15.423444 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6a13b1d1-970c-4098-90d4-536855330c33 req-cc0fa851-0f4d-43d2-8b8a-7a8bbd08a1fb tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515344 Dec 20 05:56:16.561673 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-119c91c0-7dec-4c59-8ed6-ef0225782b5e req-40c3a1d3-26cb-468b-9bfc-679cca4981c9 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:16.563072 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-119c91c0-7dec-4c59-8ed6-ef0225782b5e req-40c3a1d3-26cb-468b-9bfc-679cca4981c9 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0591917 Dec 20 05:56:16.621879 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-119c91c0-7dec-4c59-8ed6-ef0225782b5e req-ebce4457-393f-4837-bf13-619bb011ad09 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523164 Dec 20 05:56:17.741883 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b8cfbb-d2bf-49f4-a6d7-d3a444790abc req-3f034c62-bc07-4b04-b68f-005823cc6131 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:17.744799 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-29b8cfbb-d2bf-49f4-a6d7-d3a444790abc req-3f034c62-bc07-4b04-b68f-005823cc6131 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0511801 Dec 20 05:56:17.792806 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-29b8cfbb-d2bf-49f4-a6d7-d3a444790abc req-d0e8e102-da22-4862-8e27-b58531b814c3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412853 Dec 20 05:56:18.918518 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9afc0919-9a2e-496e-9a20-f7880d49fc7c req-8cd93e38-2ac0-493e-a842-afd615bad42e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:18.920173 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9afc0919-9a2e-496e-9a20-f7880d49fc7c req-8cd93e38-2ac0-493e-a842-afd615bad42e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0555723 Dec 20 05:56:18.969711 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9afc0919-9a2e-496e-9a20-f7880d49fc7c req-cb6a9020-8981-4163-a0ea-3a8b2fecf2d8 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433149 Dec 20 05:56:20.093147 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54c72e4c-d2d5-476c-8c41-fc36045e0634 req-8b1d5d45-192c-4fed-83d0-21d78969ddc0 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:20.100078 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-54c72e4c-d2d5-476c-8c41-fc36045e0634 req-8b1d5d45-192c-4fed-83d0-21d78969ddc0 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0574501 Dec 20 05:56:20.143876 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-54c72e4c-d2d5-476c-8c41-fc36045e0634 req-94c26ec1-85ca-420e-859d-ccbb89eb717f tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424330 Dec 20 05:56:20.952349 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-b59b7fef-af51-4328-b710-9d5c16c0aea7 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:20.953941 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-b59b7fef-af51-4328-b710-9d5c16c0aea7 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/networks?id=9da693b1-1216-4020-9114-46c9936e8a72 HTTP/1.1" status: 200 len: 813 time: 0.1082664 Dec 20 05:56:20.969594 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-f6218da6-32a2-4df2-b430-b499c9ebf310 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/quotas/a0ce0dc0b4da4cb093e9599f5cddd0c9 HTTP/1.1" status: 200 len: 375 time: 0.0099118 Dec 20 05:56:21.003708 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-3b981b20-2403-421a-80f7-4c0e2f3d120c tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=a0ce0dc0b4da4cb093e9599f5cddd0c9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0280683 Dec 20 05:56:21.109168 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-0fdf96ee-60df-4076-94f6-51967186540a service neutron] 10.222.0.46 "GET /v2.0/networks/9da693b1-1216-4020-9114-46c9936e8a72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0978374 Dec 20 05:56:21.198930 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-83ca1813-01d7-42d6-9501-02f47476fc56 service neutron] 10.222.0.46 "GET /v2.0/networks/9da693b1-1216-4020-9114-46c9936e8a72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831728 Dec 20 05:56:21.286163 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa6b1d82-c45d-4879-a006-8a0529e5df5e req-feddc343-998c-4720-8853-4aa4a071bc33 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:21.287659 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-aa6b1d82-c45d-4879-a006-8a0529e5df5e req-feddc343-998c-4720-8853-4aa4a071bc33 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0525534 Dec 20 05:56:21.344816 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-aa6b1d82-c45d-4879-a006-8a0529e5df5e req-f5e7a254-c982-4c08-955a-31e0c878d545 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506804 Dec 20 05:56:21.418064 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e46f39fb-f8d3-4db5-ae0b-14fbfbfe3732 req-e7454b89-8a63-44ae-a08c-5a72747c831b tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 210 time: 0.0449593 Dec 20 05:56:22.591265 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c9d96f77-d125-4913-8b2d-1cc10fa45fd4 req-992f24b5-19b8-46a8-8ba6-1d5303fdbc30 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 210 time: 0.0581322 Dec 20 05:56:22.654425 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18834a52-03ac-4eac-8796-ed297886fc87 req-524acc90-bc32-42c0-bb29-b06f3a5d3140 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:22.656317 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-18834a52-03ac-4eac-8796-ed297886fc87 req-524acc90-bc32-42c0-bb29-b06f3a5d3140 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.1933038 Dec 20 05:56:22.718967 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-f64ed4e7-671f-48b2-bf0a-a244ee8e16d5 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:22.720796 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-f64ed4e7-671f-48b2-bf0a-a244ee8e16d5 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.54 "GET /v2.0/networks?id=9da693b1-1216-4020-9114-46c9936e8a72 HTTP/1.1" status: 200 len: 813 time: 0.2196751 Dec 20 05:56:22.748417 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-ac519623-f071-4ba5-82e7-f8d48499aa6e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Request body: {'port': {'device_id': '37b0a0f2-7827-455d-9224-50466a2eb445', 'network_id': '9da693b1-1216-4020-9114-46c9936e8a72', 'admin_state_up': True, 'tenant_id': 'a0ce0dc0b4da4cb093e9599f5cddd0c9'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:22.777009 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-18834a52-03ac-4eac-8796-ed297886fc87 req-a662bfb2-6960-463c-87c3-9644c8982775 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1087239 Dec 20 05:56:22.912634 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-ac519623-f071-4ba5-82e7-f8d48499aa6e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Made reservation on behalf of a0ce0dc0b4da4cb093e9599f5cddd0c9 for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:56:22.916899 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-ac519623-f071-4ba5-82e7-f8d48499aa6e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:22.998963 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:56:23.086191 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-ac519623-f071-4ba5-82e7-f8d48499aa6e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Allocated IP 172.20.0.4 (9da693b1-1216-4020-9114-46c9936e8a72/8265e939-4727-4318-be2f-9d57754a238e/bf46fd9d-2baf-433d-8177-480c5b1b86de) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:56:23.263915 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-ac519623-f071-4ba5-82e7-f8d48499aa6e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:23.299578 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-ac519623-f071-4ba5-82e7-f8d48499aa6e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:23.348875 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-ac519623-f071-4ba5-82e7-f8d48499aa6e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Network 9da693b1-1216-4020-9114-46c9936e8a72 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:56:23.352440 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-ac519623-f071-4ba5-82e7-f8d48499aa6e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:23.356267 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-ac519623-f071-4ba5-82e7-f8d48499aa6e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:56:23.363610 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac519623-f071-4ba5-82e7-f8d48499aa6e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Pushing event updated for resources: {'Port': ['ID=bf46fd9d-2baf-433d-8177-480c5b1b86de,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.617961 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.620869 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.620869 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.620869 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.620869 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.620869 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.620869 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.620869 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.620869 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.620869 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.620869 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.620869 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:23.620869 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:23.626997 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-ac519623-f071-4ba5-82e7-f8d48499aa6e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:23.627711 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-ac519623-f071-4ba5-82e7-f8d48499aa6e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:23.648257 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-ac519623-f071-4ba5-82e7-f8d48499aa6e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9051197 Dec 20 05:56:23.671488 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Request body: {'port': {'device_id': '37b0a0f2-7827-455d-9224-50466a2eb445', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:23.770476 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:23.800091 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beca04ab-9d58-40d5-810e-e2980c9273c0 req-9d93d285-52ff-42cc-9813-59be5a1115ad tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:23.802010 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-beca04ab-9d58-40d5-810e-e2980c9273c0 req-9d93d285-52ff-42cc-9813-59be5a1115ad tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 931 time: 0.1067357 Dec 20 05:56:23.949785 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-beca04ab-9d58-40d5-810e-e2980c9273c0 req-fc6973d1-a95d-4df9-bcdc-db5f91be4269 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1307783 Dec 20 05:56:24.007414 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93b0124e-18b3-457d-ae37-086904972079 req-abf6e3fc-0359-4eaf-a2fd-e90199041768 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:24.010615 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-93b0124e-18b3-457d-ae37-086904972079 req-abf6e3fc-0359-4eaf-a2fd-e90199041768 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.1391835 Dec 20 05:56:24.130580 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-93b0124e-18b3-457d-ae37-086904972079 req-9c7a8980-ed4f-4249-9336-b10c0ce38259 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1089702 Dec 20 05:56:24.215711 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bf46fd9d-2baf-433d-8177-480c5b1b86de {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:56:24.224103 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:24.238099 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Transition to ACTIVE for port object bf46fd9d-2baf-433d-8177-480c5b1b86de will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 05:56:24.243792 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:24.296570 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Pushing event updated for resources: {'Port': ['ID=bf46fd9d-2baf-433d-8177-480c5b1b86de,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:24.361616 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Attempting to bind port bf46fd9d-2baf-433d-8177-480c5b1b86de on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:56:24.361960 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Attempting to bind port bf46fd9d-2baf-433d-8177-480c5b1b86de by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': '62bdd930-d981-4fed-ad58-9d410d5c0393', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 418, 'network_id': '9da693b1-1216-4020-9114-46c9936e8a72'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:56:24.362314 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Attempting to bind port bf46fd9d-2baf-433d-8177-480c5b1b86de on network 9da693b1-1216-4020-9114-46c9936e8a72 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:56:24.366809 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Port bf46fd9d-2baf-433d-8177-480c5b1b86de on network 9da693b1-1216-4020-9114-46c9936e8a72 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 05:56:24.367163 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Attempting to bind port bf46fd9d-2baf-433d-8177-480c5b1b86de on network 9da693b1-1216-4020-9114-46c9936e8a72 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:56:24.372589 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 56, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:56:24.372929 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Checking segment: {'id': '62bdd930-d981-4fed-ad58-9d410d5c0393', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 418, 'network_id': '9da693b1-1216-4020-9114-46c9936e8a72'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:56:24.373308 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Bound using segment: {'id': '62bdd930-d981-4fed-ad58-9d410d5c0393', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 418, 'network_id': '9da693b1-1216-4020-9114-46c9936e8a72'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:56:24.373733 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Bound port: bf46fd9d-2baf-433d-8177-480c5b1b86de, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '62bdd930-d981-4fed-ad58-9d410d5c0393', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 418, 'network_id': '9da693b1-1216-4020-9114-46c9936e8a72'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:56:24.374087 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:24.450793 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] For port bf46fd9d-2baf-433d-8177-480c5b1b86de, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:56:24.454467 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] For port bf46fd9d-2baf-433d-8177-480c5b1b86de, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=bf46fd9d-2baf-433d-8177-480c5b1b86de,segment=NetworkSegment(62bdd930-d981-4fed-ad58-9d410d5c0393),segment_id=62bdd930-d981-4fed-ad58-9d410d5c0393)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:56:24.461463 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:24.501658 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:24.502246 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:24.503719 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-4745dac1-6132-4111-a731-0f816684e8be service neutron] 10.222.0.54 "PUT /v2.0/ports/bf46fd9d-2baf-433d-8177-480c5b1b86de HTTP/1.1" status: 200 len: 1093 time: 0.8380656 Dec 20 05:56:24.504228 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '37b0a0f2-7827-455d-9224-50466a2eb445', 'tag': 'bf46fd9d-2baf-433d-8177-480c5b1b86de'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:56:24.506522 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-53950353-3a1f-452a-8557-60e62b613441" -d '{"events": [{"name": "network-changed", "server_uuid": "37b0a0f2-7827-455d-9224-50466a2eb445", "tag": "bf46fd9d-2baf-433d-8177-480c5b1b86de"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:56:24.526084 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4745dac1-6132-4111-a731-0f816684e8be service neutron] Pushing event updated for resources: {'Port': ['ID=bf46fd9d-2baf-433d-8177-480c5b1b86de,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:24.555506 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:56:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9071a8c5-fa64-4409-9a3d-19a8e6384d3b x-openstack-request-id: req-9071a8c5-fa64-4409-9a3d-19a8e6384d3b {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:56:24.556465 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "37b0a0f2-7827-455d-9224-50466a2eb445", "tag": "bf46fd9d-2baf-433d-8177-480c5b1b86de", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:56:24.556761 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-9071a8c5-fa64-4409-9a3d-19a8e6384d3b {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:56:24.557283 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '37b0a0f2-7827-455d-9224-50466a2eb445', 'tag': 'bf46fd9d-2baf-433d-8177-480c5b1b86de', 'status': 'completed', 'code': 200} Dec 20 05:56:24.700512 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-1d07f741-62fc-4073-b288-d0095c7b793d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:24.702751 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-1d07f741-62fc-4073-b288-d0095c7b793d service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a0ce0dc0b4da4cb093e9599f5cddd0c9&device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 1096 time: 0.0430202 Dec 20 05:56:24.780519 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-69b1310c-84b2-4ed7-891f-b6da4a228cb7 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=bf46fd9d-2baf-433d-8177-480c5b1b86de HTTP/1.1" status: 200 len: 217 time: 0.0540211 Dec 20 05:56:24.838492 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-8ff5bcca-3d3b-4725-821f-8ba7635a6afb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:24.840072 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-8ff5bcca-3d3b-4725-821f-8ba7635a6afb service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8265e939-4727-4318-be2f-9d57754a238e HTTP/1.1" status: 200 len: 853 time: 0.0450354 Dec 20 05:56:24.889373 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-1dd8d1a5-c3b8-464d-8573-79fb43fa25a6 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=9da693b1-1216-4020-9114-46c9936e8a72&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0308015 Dec 20 05:56:25.003121 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-38e1e9f3-f363-44fe-ab7b-366f0722526d service neutron] 10.222.0.54 "GET /v2.0/networks/9da693b1-1216-4020-9114-46c9936e8a72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1043243 Dec 20 05:56:25.199111 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-248cec99-2222-4837-b94a-b015770e55d8 req-4cc62b91-05f6-44d8-846b-eb031bd322a0 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:25.202493 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-248cec99-2222-4837-b94a-b015770e55d8 req-4cc62b91-05f6-44d8-846b-eb031bd322a0 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 943 time: 0.1538882 Dec 20 05:56:25.286355 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d47c99e-b088-496c-b783-0cd7751d9916 req-baa98a91-2b44-4e55-800a-953cbea0fe84 service neutron] 10.222.0.54 "GET /v2.0/networks/9da693b1-1216-4020-9114-46c9936e8a72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2713888 Dec 20 05:56:25.344673 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-248cec99-2222-4837-b94a-b015770e55d8 req-1f606cfd-4dcf-49bc-863e-b965b97ff40a tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1345456 Dec 20 05:56:25.357244 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92fbcf73-3a49-46bb-bb2f-1b327decc9b9 req-7a33430a-6ddc-4766-b9a5-a19f29973ed1 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:25.359285 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-92fbcf73-3a49-46bb-bb2f-1b327decc9b9 req-7a33430a-6ddc-4766-b9a5-a19f29973ed1 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.1288528 Dec 20 05:56:25.469245 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-92fbcf73-3a49-46bb-bb2f-1b327decc9b9 req-ffffdc06-df4b-4845-8043-7dd23784a3a8 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0993612 Dec 20 05:56:25.485091 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53950353-3a1f-452a-8557-60e62b613441 req-c942e300-f234-4cb7-9312-b09bae7ad9bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:25.486864 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-53950353-3a1f-452a-8557-60e62b613441 req-c942e300-f234-4cb7-9312-b09bae7ad9bf service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a0ce0dc0b4da4cb093e9599f5cddd0c9&device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 1096 time: 0.0664914 Dec 20 05:56:25.594575 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53950353-3a1f-452a-8557-60e62b613441 req-9244877b-1945-474d-8c53-ea1599aee39b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:25.596545 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-53950353-3a1f-452a-8557-60e62b613441 req-9244877b-1945-474d-8c53-ea1599aee39b service neutron] 10.222.0.54 "GET /v2.0/networks?id=9da693b1-1216-4020-9114-46c9936e8a72 HTTP/1.1" status: 200 len: 914 time: 0.1016719 Dec 20 05:56:25.652590 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-53950353-3a1f-452a-8557-60e62b613441 req-aa089f83-62de-4097-b0b5-ee046c2e3fec service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=bf46fd9d-2baf-433d-8177-480c5b1b86de HTTP/1.1" status: 200 len: 217 time: 0.0477705 Dec 20 05:56:25.710929 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53950353-3a1f-452a-8557-60e62b613441 req-bb37bbaa-8f77-44c4-825f-fed4a8f8ad1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:25.713419 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-53950353-3a1f-452a-8557-60e62b613441 req-bb37bbaa-8f77-44c4-825f-fed4a8f8ad1f service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8265e939-4727-4318-be2f-9d57754a238e HTTP/1.1" status: 200 len: 853 time: 0.0517921 Dec 20 05:56:25.750258 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-53950353-3a1f-452a-8557-60e62b613441 req-5800e5f8-6d9a-49f5-bcbf-b976a7211795 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=9da693b1-1216-4020-9114-46c9936e8a72&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0292070 Dec 20 05:56:25.879129 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-53950353-3a1f-452a-8557-60e62b613441 req-1ab02ba4-c19c-4fe2-8200-f0e7fda30c3f service neutron] 10.222.0.54 "GET /v2.0/networks/9da693b1-1216-4020-9114-46c9936e8a72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1182549 Dec 20 05:56:25.985762 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-53950353-3a1f-452a-8557-60e62b613441 req-e3e11b2e-72d5-4591-b007-f9e8a3896558 service neutron] 10.222.0.54 "GET /v2.0/networks/9da693b1-1216-4020-9114-46c9936e8a72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0984449 Dec 20 05:56:26.487414 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-428831fe-874a-4d98-989f-7c96c0baf9fe req-3397b5d6-b9fd-4e90-abf5-8dde0bdc91e8 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:26.488846 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-428831fe-874a-4d98-989f-7c96c0baf9fe req-3397b5d6-b9fd-4e90-abf5-8dde0bdc91e8 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 943 time: 0.0606666 Dec 20 05:56:26.548872 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-428831fe-874a-4d98-989f-7c96c0baf9fe req-45cc4295-5230-49e5-99b1-0f3ee66dccab tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539358 Dec 20 05:56:26.637804 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e9aa445-d244-4328-aebb-5a59a3541c6f req-bcb15117-6cce-4612-9f9e-634b87106f73 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:26.640236 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e9aa445-d244-4328-aebb-5a59a3541c6f req-bcb15117-6cce-4612-9f9e-634b87106f73 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0728030 Dec 20 05:56:26.713593 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e9aa445-d244-4328-aebb-5a59a3541c6f req-4151141f-47e1-4575-b8d1-4518c57b6ed6 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665083 Dec 20 05:56:27.028824 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-c89831fe-f0c2-4e43-8c6a-a8965661b502 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1384921729&fields=id&tenant_id=a67a7ba727e54b1c9f6ca2d5ea21f272 HTTP/1.1" status: 200 len: 267 time: 0.0459759 Dec 20 05:56:27.140590 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-9ff7eb03-5057-4867-8402-7af4cbeac9e7 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:27.142051 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-9ff7eb03-5057-4867-8402-7af4cbeac9e7 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/networks?id=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 HTTP/1.1" status: 200 len: 809 time: 0.1060607 Dec 20 05:56:27.159034 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-1fbd92aa-5c5f-433b-bc35-d5cc95d2ec79 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/quotas/a67a7ba727e54b1c9f6ca2d5ea21f272 HTTP/1.1" status: 200 len: 375 time: 0.0108166 Dec 20 05:56:27.216563 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-9ff6459d-dd43-42b9-83a3-27acdf93cd84 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=a67a7ba727e54b1c9f6ca2d5ea21f272&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0462236 Dec 20 05:56:27.311293 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-fb445bd9-acd2-4505-a3b8-8d4befebb50b service neutron] 10.222.0.46 "GET /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0806646 Dec 20 05:56:27.399657 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-47690472-1a0b-4842-8081-bb88d8f8d722 service neutron] 10.222.0.46 "GET /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823667 Dec 20 05:56:27.677030 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff25726f-37be-4d46-bc6a-468dde36b02b req-3e781b4c-547a-4974-8a15-b36551e43198 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:27.678454 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ff25726f-37be-4d46-bc6a-468dde36b02b req-3e781b4c-547a-4974-8a15-b36551e43198 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 943 time: 0.0596445 Dec 20 05:56:27.697110 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-934f1cf5-59e4-411d-9a2f-a04ed9bd759a req-a9a0fc6b-22d2-465b-ac37-492536b1e7cd tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 210 time: 0.0361249 Dec 20 05:56:27.746481 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ff25726f-37be-4d46-bc6a-468dde36b02b req-2c988d7b-780f-465f-83e4-c81a9cae93f4 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516119 Dec 20 05:56:27.836256 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a1d8cfb-6aec-484d-b533-6a8b4710e509 req-9bee484a-07bf-402d-b042-1cbafa281ba8 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:27.837776 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6a1d8cfb-6aec-484d-b533-6a8b4710e509 req-9bee484a-07bf-402d-b042-1cbafa281ba8 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0518711 Dec 20 05:56:27.888321 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6a1d8cfb-6aec-484d-b533-6a8b4710e509 req-b3c69d9b-4540-482f-8b44-e3b7c106f19b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438523 Dec 20 05:56:27.892087 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device bf46fd9d-2baf-433d-8177-480c5b1b86de details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:56:28.013325 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port bf46fd9d-2baf-433d-8177-480c5b1b86de, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=bf46fd9d-2baf-433d-8177-480c5b1b86de,segment=NetworkSegment(62bdd930-d981-4fed-ad58-9d410d5c0393),segment_id=62bdd930-d981-4fed-ad58-9d410d5c0393)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:56:28.024162 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': 'bf46fd9d-2baf-433d-8177-480c5b1b86de', 'network_id': '9da693b1-1216-4020-9114-46c9936e8a72', 'port_id': 'bf46fd9d-2baf-433d-8177-480c5b1b86de', 'mac_address': 'fa:16:3e:f4:70:14', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 418, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8265e939-4727-4318-be2f-9d57754a238e', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:56:28.066721 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:28.082836 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bf46fd9d-2baf-433d-8177-480c5b1b86de {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:56:28.103873 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port bf46fd9d-2baf-433d-8177-480c5b1b86de, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=bf46fd9d-2baf-433d-8177-480c5b1b86de,segment=NetworkSegment(62bdd930-d981-4fed-ad58-9d410d5c0393),segment_id=62bdd930-d981-4fed-ad58-9d410d5c0393)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:56:28.109176 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:28.159578 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=bf46fd9d-2baf-433d-8177-480c5b1b86de,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:28.532194 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['bf46fd9d-2baf-433d-8177-480c5b1b86de'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:56:28.827934 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb20f086-20a0-4c91-b993-54611a3bcc0e req-b7e7dc20-4324-4141-baa7-968c65f4425b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 210 time: 0.0621693 Dec 20 05:56:28.900360 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-0056f82d-d9b6-404a-b29a-e7de97b06c9b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:28.902286 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-0056f82d-d9b6-404a-b29a-e7de97b06c9b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.54 "GET /v2.0/networks?id=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 HTTP/1.1" status: 200 len: 809 time: 0.1600161 Dec 20 05:56:28.912620 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ee472a-aa3e-4b2f-9f32-a44a295af48f req-74e40d0c-e60f-45b7-ae75-db2592c1e83a tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:28.914038 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-85ee472a-aa3e-4b2f-9f32-a44a295af48f req-74e40d0c-e60f-45b7-ae75-db2592c1e83a tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 944 time: 0.0834324 Dec 20 05:56:29.005936 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-85ee472a-aa3e-4b2f-9f32-a44a295af48f req-f454f27a-3caf-4c2b-ad1a-9d017a0a776b tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0854974 Dec 20 05:56:29.058920 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145fc882-8c07-4398-a980-67d7e53c3353 req-4c94a973-f033-435a-bdf0-aaed5496a7cf tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:29.060431 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-145fc882-8c07-4398-a980-67d7e53c3353 req-4c94a973-f033-435a-bdf0-aaed5496a7cf tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0967875 Dec 20 05:56:29.065742 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-0eab9324-3e56-4cd4-b9b3-4cc7bc0fd1d1 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a67a7ba727e54b1c9f6ca2d5ea21f272 HTTP/1.1" status: 200 len: 380 time: 0.1135585 Dec 20 05:56:29.084894 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-ef6736b2-2f51-416e-9bf3-9cc2d7af9d82 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Request body: {'port': {'device_id': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'admin_state_up': True, 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'security_groups': ['0ee7077b-2ff5-4a83-bf29-d30984dea2c7']}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:29.167161 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-145fc882-8c07-4398-a980-67d7e53c3353 req-33b3c57b-bce9-4188-b5bb-7bc7361b2cb0 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1004128 Dec 20 05:56:29.211752 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-ef6736b2-2f51-416e-9bf3-9cc2d7af9d82 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Made reservation on behalf of a67a7ba727e54b1c9f6ca2d5ea21f272 for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:56:29.215628 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-ef6736b2-2f51-416e-9bf3-9cc2d7af9d82 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:29.336489 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-ef6736b2-2f51-416e-9bf3-9cc2d7af9d82 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Allocated IP 172.20.0.6 (0dda46a2-d87a-46ca-89fc-3cf651bd2fc3/a2b892f1-223d-4384-8544-8bbbbe5c621b/8a9f4386-7528-40a4-9b44-826be10f5c21) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:56:29.472633 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-ef6736b2-2f51-416e-9bf3-9cc2d7af9d82 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:29.504203 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-ef6736b2-2f51-416e-9bf3-9cc2d7af9d82 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:29.546440 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-ef6736b2-2f51-416e-9bf3-9cc2d7af9d82 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:56:29.549519 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-ef6736b2-2f51-416e-9bf3-9cc2d7af9d82 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:29.552945 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-ef6736b2-2f51-416e-9bf3-9cc2d7af9d82 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:56:29.578535 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef6736b2-2f51-416e-9bf3-9cc2d7af9d82 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Pushing event updated for resources: {'Port': ['ID=8a9f4386-7528-40a4-9b44-826be10f5c21,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:29.609941 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-ef6736b2-2f51-416e-9bf3-9cc2d7af9d82 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:29.610725 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-ef6736b2-2f51-416e-9bf3-9cc2d7af9d82 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:29.626809 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-ef6736b2-2f51-416e-9bf3-9cc2d7af9d82 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5476229 Dec 20 05:56:29.659983 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Request body: {'port': {'device_id': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:29.697909 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46634) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:29.730389 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:29.743304 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_v2 [None req-e9e22793-3aad-45a3-a92d-d491b4665a56 admin admin] Deleting subnet 2c54f9a1-64d2-45bf-94c0-c7d4cd8d6225 {{(pid=102446) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 05:56:29.746685 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e9e22793-3aad-45a3-a92d-d491b4665a56 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:29.790248 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e9e22793-3aad-45a3-a92d-d491b4665a56 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8976279'] for subnet, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:29.797542 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-5cd30e97-0a22-4b57-9e19-2d45567abda0 None None] Provisioning complete for port 8a9f4386-7528-40a4-9b44-826be10f5c21 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:29.798627 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-5cd30e97-0a22-4b57-9e19-2d45567abda0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:29.835556 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e9e22793-3aad-45a3-a92d-d491b4665a56 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:29.840221 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-5cd30e97-0a22-4b57-9e19-2d45567abda0 None None] Port 8a9f4386-7528-40a4-9b44-826be10f5c21 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:56:29.885322 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device bf46fd9d-2baf-433d-8177-480c5b1b86de up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:29.897034 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e9e22793-3aad-45a3-a92d-d491b4665a56 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9173344', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3270978'] for subnet, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:29.938624 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9e22793-3aad-45a3-a92d-d491b4665a56 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2c54f9a1-64d2-45bf-94c0-c7d4cd8d6225,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:29.940888 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e9e22793-3aad-45a3-a92d-d491b4665a56 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:29.944487 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-e9e22793-3aad-45a3-a92d-d491b4665a56 admin admin] 10.222.0.46 "DELETE /v2.0/subnets/2c54f9a1-64d2-45bf-94c0-c7d4cd8d6225 HTTP/1.1" status: 204 len: 168 time: 0.2454078 Dec 20 05:56:29.946852 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46638) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:29.948550 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port bf46fd9d-2baf-433d-8177-480c5b1b86de completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 05:56:29.952879 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port bf46fd9d-2baf-433d-8177-480c5b1b86de triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:29.953306 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.008471 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe56fe4f-7bf1-4d50-b74a-f603065fb951 req-7a6aaf64-26cb-45e4-9b8a-5953135c2dd2 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:30.010543 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fe56fe4f-7bf1-4d50-b74a-f603065fb951 req-7a6aaf64-26cb-45e4-9b8a-5953135c2dd2 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 931 time: 0.0781834 Dec 20 05:56:30.019742 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2b1a3cfc-6ea7-4e6e-8948-c35252ac1c93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.058947 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.090843 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '37b0a0f2-7827-455d-9224-50466a2eb445', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf46fd9d-2baf-433d-8177-480c5b1b86de'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:56:30.093684 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-557a2329-1a98-47d5-80c2-585a83729b6a" -d '{"events": [{"server_uuid": "37b0a0f2-7827-455d-9224-50466a2eb445", "name": "network-vif-plugged", "status": "completed", "tag": "bf46fd9d-2baf-433d-8177-480c5b1b86de"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:56:30.099842 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2b1a3cfc-6ea7-4e6e-8948-c35252ac1c93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.100708 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8a9f4386-7528-40a4-9b44-826be10f5c21 {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:56:30.108747 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fe56fe4f-7bf1-4d50-b74a-f603065fb951 req-eaa6e8df-a181-40b1-82a2-d9739dfa097c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0911834 Dec 20 05:56:30.110112 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port bf46fd9d-2baf-433d-8177-480c5b1b86de, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=bf46fd9d-2baf-433d-8177-480c5b1b86de,segment=NetworkSegment(62bdd930-d981-4fed-ad58-9d410d5c0393),segment_id=62bdd930-d981-4fed-ad58-9d410d5c0393)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:56:30.114137 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.114384 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.131054 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-2b1a3cfc-6ea7-4e6e-8948-c35252ac1c93 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ebca9b29-55b2-47f1-bcfb-6bced6fdc050']}} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:30.141994 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-2b1a3cfc-6ea7-4e6e-8948-c35252ac1c93 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e86c45d4-b3d7-41e1-892c-83dec0fca686') {'for_net_delete': True} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:30.142304 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-2b1a3cfc-6ea7-4e6e-8948-c35252ac1c93 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e86c45d4-b3d7-41e1-892c-83dec0fca686') {} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:30.156728 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Transition to ACTIVE for port object 8a9f4386-7528-40a4-9b44-826be10f5c21 will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 05:56:30.161823 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2b1a3cfc-6ea7-4e6e-8948-c35252ac1c93 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8976286'] for segment, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.167784 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.181639 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1adbb604-a7a6-4351-a6d9-6236e2cd083d req-a1d66043-2932-4d6d-81c2-09260a3f0250 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:30.183344 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1adbb604-a7a6-4351-a6d9-6236e2cd083d req-a1d66043-2932-4d6d-81c2-09260a3f0250 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 945 time: 0.0714419 Dec 20 05:56:30.190717 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:56:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1588f799-b8c8-49a7-9368-9872ebf47af8 x-openstack-request-id: req-1588f799-b8c8-49a7-9368-9872ebf47af8 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:56:30.191033 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "37b0a0f2-7827-455d-9224-50466a2eb445", "name": "network-vif-plugged", "status": "completed", "tag": "bf46fd9d-2baf-433d-8177-480c5b1b86de", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:56:30.191294 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-1588f799-b8c8-49a7-9368-9872ebf47af8 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:56:30.191807 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '37b0a0f2-7827-455d-9224-50466a2eb445', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf46fd9d-2baf-433d-8177-480c5b1b86de', 'code': 200} Dec 20 05:56:30.193011 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=bf46fd9d-2baf-433d-8177-480c5b1b86de,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:30.203772 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2b1a3cfc-6ea7-4e6e-8948-c35252ac1c93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.224468 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2b1a3cfc-6ea7-4e6e-8948-c35252ac1c93 admin admin] Releasing vlan 403 on physical network physnet1 to pool {{(pid=102446) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 05:56:30.225238 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2b1a3cfc-6ea7-4e6e-8948-c35252ac1c93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9173254'] for segment, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: Traceback (most recent call last): Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: timer() Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: cb(*args, **kw) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: return func(*args, **kwargs) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: self._notify() Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: self.callback(batched_events) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: event.method(event) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: return f(self, *a, **k) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._get(url).json() Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: return self.request(url, 'GET', **kwargs) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 05:56:30.228598 dv-cinder-822278-1-iscsi neutron-server[102446]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 05:56:30.302946 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Pushing event updated for resources: {'Port': ['ID=8a9f4386-7528-40a4-9b44-826be10f5c21,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:30.306577 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2b1a3cfc-6ea7-4e6e-8948-c35252ac1c93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.318779 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2b1a3cfc-6ea7-4e6e-8948-c35252ac1c93 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.326147 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-2b1a3cfc-6ea7-4e6e-8948-c35252ac1c93 admin admin] 10.222.0.46 "DELETE /v2.0/networks/ebca9b29-55b2-47f1-bcfb-6bced6fdc050 HTTP/1.1" status: 204 len: 168 time: 0.3780539 Dec 20 05:56:30.339773 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b1a3cfc-6ea7-4e6e-8948-c35252ac1c93 admin admin] Pushing event deleted for resources: {'Network': ['ID=ebca9b29-55b2-47f1-bcfb-6bced6fdc050,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:30.354067 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1adbb604-a7a6-4351-a6d9-6236e2cd083d req-ab1f4573-361c-425c-a043-3b20b6378cd7 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1464944 Dec 20 05:56:30.398317 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Attempting to bind port 8a9f4386-7528-40a4-9b44-826be10f5c21 on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:56:30.398728 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Attempting to bind port 8a9f4386-7528-40a4-9b44-826be10f5c21 by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': 'e14b6241-3561-4b23-bd30-af836d346b40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 407, 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:56:30.399136 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Attempting to bind port 8a9f4386-7528-40a4-9b44-826be10f5c21 on network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:56:30.413449 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aafc7247-8a1c-47eb-8863-1386487317fe req-758e0fbb-6dbf-4dbc-b32b-3fabd6f5fa7a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:30.415738 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-aafc7247-8a1c-47eb-8863-1386487317fe req-758e0fbb-6dbf-4dbc-b32b-3fabd6f5fa7a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.1319008 Dec 20 05:56:30.416618 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Port 8a9f4386-7528-40a4-9b44-826be10f5c21 on network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 05:56:30.417007 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Attempting to bind port 8a9f4386-7528-40a4-9b44-826be10f5c21 on network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:56:30.422857 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 56, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:56:30.423192 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Checking segment: {'id': 'e14b6241-3561-4b23-bd30-af836d346b40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 407, 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:56:30.423601 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Bound using segment: {'id': 'e14b6241-3561-4b23-bd30-af836d346b40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 407, 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:56:30.424031 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Bound port: 8a9f4386-7528-40a4-9b44-826be10f5c21, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e14b6241-3561-4b23-bd30-af836d346b40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 407, 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:56:30.424488 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.478863 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94f24f58-06f2-490b-af1f-e02fa6a40672 req-60cc532d-0b41-46e9-8713-fc23f9c5a61b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:30.480530 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-94f24f58-06f2-490b-af1f-e02fa6a40672 req-60cc532d-0b41-46e9-8713-fc23f9c5a61b service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 1098 time: 0.0503311 Dec 20 05:56:30.518195 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46650) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:30.577194 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-94f24f58-06f2-490b-af1f-e02fa6a40672 req-0e77322c-fa25-4901-935e-a36c00c66b84 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0838809 Dec 20 05:56:30.589163 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-70414520-a760-41bb-b1a4-d8a77b6f6fbe admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=c55e4805e4ec461e98ab84a95a8755d7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0698566 Dec 20 05:56:30.591695 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46652) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:30.645143 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6eaa4370-8345-4f03-89cb-2a7578d4d162 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.666377 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6eaa4370-8345-4f03-89cb-2a7578d4d162 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.716176 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6eaa4370-8345-4f03-89cb-2a7578d4d162 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.716895 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-aafc7247-8a1c-47eb-8863-1386487317fe req-f4208c4a-f5dd-4d67-8657-afc1270d5cea tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2887676 Dec 20 05:56:30.718746 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6eaa4370-8345-4f03-89cb-2a7578d4d162 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.720045 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-6eaa4370-8345-4f03-89cb-2a7578d4d162 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/42fc834a-104f-4dca-a056-79de62a35aca HTTP/1.1" status: 204 len: 168 time: 0.1274240 Dec 20 05:56:30.732661 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eaa4370-8345-4f03-89cb-2a7578d4d162 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42fc834a-104f-4dca-a056-79de62a35aca,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:30.747100 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] For port 8a9f4386-7528-40a4-9b44-826be10f5c21, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:56:30.750676 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] For port 8a9f4386-7528-40a4-9b44-826be10f5c21, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=8a9f4386-7528-40a4-9b44-826be10f5c21,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:56:30.755835 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.794850 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:30.795469 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:30.796864 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] 10.222.0.54 "PUT /v2.0/ports/8a9f4386-7528-40a4-9b44-826be10f5c21 HTTP/1.1" status: 200 len: 1093 time: 1.1413822 Dec 20 05:56:30.797322 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'tag': '8a9f4386-7528-40a4-9b44-826be10f5c21'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:56:30.799549 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-24d700c9-1ac3-4f9d-850c-71d2222cd9d8" -d '{"events": [{"name": "network-changed", "server_uuid": "7f092569-f7b1-4e5d-859b-95ab2173d63f", "tag": "8a9f4386-7528-40a4-9b44-826be10f5c21"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:56:30.830939 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8400e7a-8b2d-4354-b1f2-888b7118154d service neutron] Pushing event updated for resources: {'Port': ['ID=8a9f4386-7528-40a4-9b44-826be10f5c21,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:30.851538 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:56:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-06867607-d4fb-4fa0-be2a-57ba94449d47 x-openstack-request-id: req-06867607-d4fb-4fa0-be2a-57ba94449d47 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:56:30.851842 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7f092569-f7b1-4e5d-859b-95ab2173d63f", "tag": "8a9f4386-7528-40a4-9b44-826be10f5c21", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:56:30.852106 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-06867607-d4fb-4fa0-be2a-57ba94449d47 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:56:30.852507 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'tag': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'status': 'completed', 'code': 200} Dec 20 05:56:31.029841 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24d700c9-1ac3-4f9d-850c-71d2222cd9d8 req-f83bac7e-b875-404c-a2bd-3b494d1f6d85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:31.031326 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-24d700c9-1ac3-4f9d-850c-71d2222cd9d8 req-f83bac7e-b875-404c-a2bd-3b494d1f6d85 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a67a7ba727e54b1c9f6ca2d5ea21f272&device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 1096 time: 0.0411637 Dec 20 05:56:31.146606 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24d700c9-1ac3-4f9d-850c-71d2222cd9d8 req-3f105722-f65d-4f51-b328-4de4c9da44de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:31.148095 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-24d700c9-1ac3-4f9d-850c-71d2222cd9d8 req-3f105722-f65d-4f51-b328-4de4c9da44de service neutron] 10.222.0.54 "GET /v2.0/networks?tenant_id=a67a7ba727e54b1c9f6ca2d5ea21f272&shared=False HTTP/1.1" status: 200 len: 910 time: 0.0962563 Dec 20 05:56:31.281111 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5611e37a-c572-48c2-8a78-1a6922f41cbc req-2475a6f7-e2a0-4990-9c0c-3e0160f8eafe tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:31.282604 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5611e37a-c572-48c2-8a78-1a6922f41cbc req-2475a6f7-e2a0-4990-9c0c-3e0160f8eafe tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.0972953 Dec 20 05:56:31.285473 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24d700c9-1ac3-4f9d-850c-71d2222cd9d8 req-5a702b44-153e-4c77-96de-5311955f7c67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:31.286826 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-24d700c9-1ac3-4f9d-850c-71d2222cd9d8 req-5a702b44-153e-4c77-96de-5311955f7c67 service neutron] 10.222.0.54 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1301708 Dec 20 05:56:31.335460 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5611e37a-c572-48c2-8a78-1a6922f41cbc req-ce6cee2a-53b6-4e63-a2da-f312d84d840c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453196 Dec 20 05:56:31.436738 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-fb4e7418-773c-4c21-a333-a5718f1a3daa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:31.439081 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-fb4e7418-773c-4c21-a333-a5718f1a3daa service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a67a7ba727e54b1c9f6ca2d5ea21f272&device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 1096 time: 0.0437272 Dec 20 05:56:31.516968 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-fc7ee38d-cded-4080-af17-a82feb1ddd4b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=8a9f4386-7528-40a4-9b44-826be10f5c21 HTTP/1.1" status: 200 len: 217 time: 0.0431855 Dec 20 05:56:31.544715 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86c29344-2d8a-46a3-8606-93384ff9fdb0 req-391ed3df-5197-4a09-a2fb-5105fcc3366c tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:31.546140 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-86c29344-2d8a-46a3-8606-93384ff9fdb0 req-391ed3df-5197-4a09-a2fb-5105fcc3366c tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 945 time: 0.1001635 Dec 20 05:56:31.613461 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-6c03a43b-c627-4302-9703-5fe1e784d167 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:31.615002 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-6c03a43b-c627-4302-9703-5fe1e784d167 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2b892f1-223d-4384-8544-8bbbbe5c621b HTTP/1.1" status: 200 len: 848 time: 0.0867016 Dec 20 05:56:31.627795 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-86c29344-2d8a-46a3-8606-93384ff9fdb0 req-c1997213-91d7-4155-8913-48ab8e5ce482 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0627658 Dec 20 05:56:31.715682 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-2ed1aa90-f723-4c6e-9bfa-b4a9e553e8e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:31.733270 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-153612c9-fde7-4c86-b3e1-50a195e9a45b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:31.734967 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-153612c9-fde7-4c86-b3e1-50a195e9a45b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0568852 Dec 20 05:56:31.861369 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-d145440e-19f4-4e67-a3ff-1420a97d8e78 service neutron] 10.222.0.54 "GET /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1141596 Dec 20 05:56:31.873743 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d034f559-3145-4b8d-bfa4-8da8bcdbcbd2 req-7a09e7c0-efaf-4bf5-9a73-b39aa4103252 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:31.875150 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d034f559-3145-4b8d-bfa4-8da8bcdbcbd2 req-7a09e7c0-efaf-4bf5-9a73-b39aa4103252 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0701330 Dec 20 05:56:31.887478 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 46690) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:31.987896 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d034f559-3145-4b8d-bfa4-8da8bcdbcbd2 req-02b74262-cb0d-418d-9214-94a912347cdf tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1023848 Dec 20 05:56:32.016936 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b9fb19b3-b4a0-4551-9f9c-fd83653c3bfc req-880774e2-8769-4150-aafb-03a092803590 service neutron] 10.222.0.54 "GET /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1385210 Dec 20 05:56:32.018042 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-246c732c-36c5-4472-a569-b4e289322d33 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:32.091278 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-246c732c-36c5-4472-a569-b4e289322d33 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:32.095751 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-246c732c-36c5-4472-a569-b4e289322d33 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:32.138751 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-246c732c-36c5-4472-a569-b4e289322d33 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=da73a91dfcfb49ca9980045ad1489efe&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2423387 Dec 20 05:56:32.139641 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-246c732c-36c5-4472-a569-b4e289322d33 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d74eb1c-19c2-4a81-8bb5-d1b9f270341a,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:32.141497 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46694) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:32.195550 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-885fae44-b2f0-4d07-b6ab-db79e277b127 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:32.217842 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-885fae44-b2f0-4d07-b6ab-db79e277b127 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:32.263588 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-885fae44-b2f0-4d07-b6ab-db79e277b127 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:32.266204 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-885fae44-b2f0-4d07-b6ab-db79e277b127 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:32.270076 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-885fae44-b2f0-4d07-b6ab-db79e277b127 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/8d74eb1c-19c2-4a81-8bb5-d1b9f270341a HTTP/1.1" status: 204 len: 168 time: 0.1248884 Dec 20 05:56:32.275649 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-885fae44-b2f0-4d07-b6ab-db79e277b127 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d74eb1c-19c2-4a81-8bb5-d1b9f270341a,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:32.454959 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d81186c-babb-4c10-ab13-7696f2b9ab5e req-ca5fdf32-3365-4508-b15e-4e278063c038 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:32.456548 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2d81186c-babb-4c10-ab13-7696f2b9ab5e req-ca5fdf32-3365-4508-b15e-4e278063c038 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.0486600 Dec 20 05:56:32.506591 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2d81186c-babb-4c10-ab13-7696f2b9ab5e req-cfa0bac6-7b0b-40f5-bbeb-d3b0feee13c3 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438190 Dec 20 05:56:32.749580 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46b36c24-79e3-4a7c-ae56-faf30df8bcb9 req-0631001d-46c4-4f16-9326-5f6083904fed tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:32.750956 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46b36c24-79e3-4a7c-ae56-faf30df8bcb9 req-0631001d-46c4-4f16-9326-5f6083904fed tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 945 time: 0.0492723 Dec 20 05:56:32.798448 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46b36c24-79e3-4a7c-ae56-faf30df8bcb9 req-e9d31a02-8d5e-41c1-9c87-ff19170610d6 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414498 Dec 20 05:56:32.874156 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46734) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:32.970012 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1345420979-network', 'tenant_id': '627c52664e194163a380283ded298eb5'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:33.002301 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] Made reservation on behalf of 627c52664e194163a380283ded298eb5 for: {'network': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:56:33.004712 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.013515 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.095885 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.101125 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.107538 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b419b8c-d583-44c8-9f81-2de8083ad2ee req-3fc90b53-72a0-4858-a7cc-0e136ae46255 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:33.108952 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4b419b8c-d583-44c8-9f81-2de8083ad2ee req-3fc90b53-72a0-4858-a7cc-0e136ae46255 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0533268 Dec 20 05:56:33.123279 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] vlan segment allocate from pool success with {'vlan_id': 436, 'physical_network': 'physnet1'} {{(pid=102446) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:56:33.136990 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4484ae16-a55f-40cc-bf6a-ad8ea50924e2,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:33.142130 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.142738 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.segments_db [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] Added segment 6a78353a-8122-4f87-a059-aadb4a3c82d5 of type vlan for network 4e35b188-ad5c-4cae-9209-b7e538e3669f Dec 20 05:56:33.172639 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4b419b8c-d583-44c8-9f81-2de8083ad2ee req-6cde28f7-31b7-4368-8dd4-8147af95c5b2 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559216 Dec 20 05:56:33.199872 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.231188 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.232612 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:33.233634 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.271676 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3964531 Dec 20 05:56:33.274693 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 46768) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:33.279596 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-4403b70e-179e-48f7-a4ee-bd8a3f53430f admin admin] Request body: {'subnet': {'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1345420979-subnet', 'tenant_id': '627c52664e194163a380283ded298eb5', 'ip_version': 4}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:33.303999 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e4a3755-c7e2-4cfb-81b2-b9f67bb40e65 admin admin] Pushing event updated for resources: {'Network': ['ID=4e35b188-ad5c-4cae-9209-b7e538e3669f,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:33.304232 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4403b70e-179e-48f7-a4ee-bd8a3f53430f admin admin] Made reservation on behalf of 627c52664e194163a380283ded298eb5 for: {'subnet': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:56:33.307928 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4403b70e-179e-48f7-a4ee-bd8a3f53430f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3597747'] for subnet, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.314500 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network 4e35b188-ad5c-4cae-9209-b7e538e3669f details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:56:33.482368 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4403b70e-179e-48f7-a4ee-bd8a3f53430f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3457622', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3597789'] for subnet, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.531628 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4403b70e-179e-48f7-a4ee-bd8a3f53430f admin admin] Pushing event updated for resources: {'Subnet': ['ID=fca5c9c5-06df-4c64-840c-e8558a30dd3c,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:33.547900 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4403b70e-179e-48f7-a4ee-bd8a3f53430f admin admin] Checking segment: {'id': '6a78353a-8122-4f87-a059-aadb4a3c82d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:56:33.548257 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4403b70e-179e-48f7-a4ee-bd8a3f53430f admin admin] Network hostable DHCP agents. Network: 4e35b188-ad5c-4cae-9209-b7e538e3669f, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:56:33.565348 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4403b70e-179e-48f7-a4ee-bd8a3f53430f admin admin] Network 4e35b188-ad5c-4cae-9209-b7e538e3669f is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:56:33.583900 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-4403b70e-179e-48f7-a4ee-bd8a3f53430f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, 4e35b188-ad5c-4cae-9209-b7e538e3669f) {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:33.591638 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db30f299-46fd-4948-a39f-86b21dd2fde0 None None] Network 4e35b188-ad5c-4cae-9209-b7e538e3669f requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:56:33.601750 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4403b70e-179e-48f7-a4ee-bd8a3f53430f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:33.602333 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4403b70e-179e-48f7-a4ee-bd8a3f53430f admin admin] Publish callbacks [] for subnet, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.623109 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-4403b70e-179e-48f7-a4ee-bd8a3f53430f admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3448024 Dec 20 05:56:33.623494 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46784) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:33.629570 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:33.637510 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c102109c-c700-4b55-8ba5-4787143ad8b7 req-0d99f7a9-aae2-47d0-948f-cf98a9117039 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:33.639043 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c102109c-c700-4b55-8ba5-4787143ad8b7 req-0d99f7a9-aae2-47d0-948f-cf98a9117039 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.0646682 Dec 20 05:56:33.660183 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1698740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25959'] for router, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.661619 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1698340', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1703163', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1634740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25982'] for router, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.711944 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c102109c-c700-4b55-8ba5-4787143ad8b7 req-a02aafc6-68b0-4c9e-b4b9-b0cc9f1f3138 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0664587 Dec 20 05:56:33.722590 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf82c7edd-7168-52b9-b9ff-dee431eec71c-4e35b188-ad5c-4cae-9209-b7e538e3669f', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'project_id': '627c52664e194163a380283ded298eb5', 'fixed_ips': [{'subnet_id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c'}]}} from dv-cinder-822278-1-iscsi. {{(pid=102447) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 20 05:56:33.723878 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.725741 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:33.873073 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.db_base_plugin_common [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Allocated IP 172.20.0.2 (4e35b188-ad5c-4cae-9209-b7e538e3669f/fca5c9c5-06df-4c64-840c-e8558a30dd3c/f4176d81-24d2-4765-a3a7-586fd16e8f13) {{(pid=102447) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:56:33.876417 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:34.017604 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Publish callbacks [] for port, precommit_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:34.023384 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:34.065692 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Network 4e35b188-ad5c-4cae-9209-b7e538e3669f is already hosted by enough agents. {{(pid=102447) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:56:34.070380 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.base_scheduler [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Resources bound (agent type, host, resource id): {{(pid=102447) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:34.073425 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Received port after_create {{(pid=102447) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:56:34.077313 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:34.080947 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Pushing event updated for resources: {'Port': ['ID=f4176d81-24d2-4765-a3a7-586fd16e8f13,revision_number=1']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:34.100598 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:34.144004 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Attempting to bind port f4176d81-24d2-4765-a3a7-586fd16e8f13 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:56:34.144375 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Attempting to bind port f4176d81-24d2-4765-a3a7-586fd16e8f13 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '6a78353a-8122-4f87-a059-aadb4a3c82d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:56:34.144737 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Attempting to bind port f4176d81-24d2-4765-a3a7-586fd16e8f13 on network 4e35b188-ad5c-4cae-9209-b7e538e3669f {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:56:34.152767 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 56, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:56:34.153213 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Checking segment: {'id': '6a78353a-8122-4f87-a059-aadb4a3c82d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:56:34.153770 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:34.154216 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Bound using segment: {'id': '6a78353a-8122-4f87-a059-aadb4a3c82d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:56:34.154826 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Bound port: f4176d81-24d2-4765-a3a7-586fd16e8f13, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6a78353a-8122-4f87-a059-aadb4a3c82d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:56:34.155271 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:34.166494 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-7d61f99a-a3de-4d60-aa1c-b27dc4b39743 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:34.222077 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Allocated IP 172.27.3.69 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:56:34.228682 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] For port f4176d81-24d2-4765-a3a7-586fd16e8f13, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:56:34.232379 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] For port f4176d81-24d2-4765-a3a7-586fd16e8f13, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=f4176d81-24d2-4765-a3a7-586fd16e8f13,segment=NetworkSegment(6a78353a-8122-4f87-a059-aadb4a3c82d5),segment_id=6a78353a-8122-4f87-a059-aadb4a3c82d5)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:56:34.238039 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:34.311918 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-554d2ad1-5873-44b0-a138-d0d9a5cb4385 None None] Pushing event updated for resources: {'Port': ['ID=f4176d81-24d2-4765-a3a7-586fd16e8f13,revision_number=2']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:34.332258 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-178ebc6c-446d-49b2-8c96-d0b72c815d13 req-cbb69eb2-8265-46a6-bc99-84f3400d288d tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:34.334151 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-178ebc6c-446d-49b2-8c96-d0b72c815d13 req-cbb69eb2-8265-46a6-bc99-84f3400d288d tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0902977 Dec 20 05:56:34.359683 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:34.392539 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-178ebc6c-446d-49b2-8c96-d0b72c815d13 req-9b69e643-3d21-4dbd-88d1-dd13282f6f1d tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518417 Dec 20 05:56:34.401815 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:34.446911 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:56:34.450858 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:34.452794 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Pushing event updated for resources: {'Port': ['ID=e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:34.455150 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:56:34.833825 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d62d3a5-cb7d-4eac-89b3-da133c5055d0 req-138ede84-a85e-4747-aeb5-8513b6cb9461 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:34.835321 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9d62d3a5-cb7d-4eac-89b3-da133c5055d0 req-138ede84-a85e-4747-aeb5-8513b6cb9461 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.0515184 Dec 20 05:56:34.910758 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9d62d3a5-cb7d-4eac-89b3-da133c5055d0 req-5ff97885-3478-4be4-aa39-7b7d6f5a7ff4 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0689111 Dec 20 05:56:34.924111 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58b9494f-371c-4a0e-9191-40e42da98064 req-87d35d92-c22c-459a-8c66-ac7d76c343f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:34.925613 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58b9494f-371c-4a0e-9191-40e42da98064 req-87d35d92-c22c-459a-8c66-ac7d76c343f6 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a2e9de0d64e642f08bf90d402e77baa3&device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 1098 time: 0.0557377 Dec 20 05:56:34.935844 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:34.991538 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:35.065834 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58b9494f-371c-4a0e-9191-40e42da98064 req-e7879f8b-6b88-4a13-9859-230e515b9419 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:35.067317 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58b9494f-371c-4a0e-9191-40e42da98064 req-e7879f8b-6b88-4a13-9859-230e515b9419 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a HTTP/1.1" status: 200 len: 920 time: 0.0959430 Dec 20 05:56:35.117341 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58b9494f-371c-4a0e-9191-40e42da98064 req-68855dda-7d3c-4b33-84f5-aa5bd52c892a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 HTTP/1.1" status: 200 len: 217 time: 0.0408905 Dec 20 05:56:35.169271 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1698355', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1703078'] for router, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:35.179990 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58b9494f-371c-4a0e-9191-40e42da98064 req-a0d79f5f-1cf9-4cab-ae95-744bfc96bae6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:35.181535 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58b9494f-371c-4a0e-9191-40e42da98064 req-a0d79f5f-1cf9-4cab-ae95-744bfc96bae6 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=e1658c3d-4c2e-4687-a529-637456d3a81c HTTP/1.1" status: 200 len: 859 time: 0.0493162 Dec 20 05:56:35.220954 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58b9494f-371c-4a0e-9191-40e42da98064 req-641e47f8-2d90-4428-8a56-0ffce1149ab8 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0282185 Dec 20 05:56:35.281357 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92dacf2c-52fb-4029-860d-fb297cd8f242 None None] Network 4e35b188-ad5c-4cae-9209-b7e538e3669f requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:56:35.322143 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Router 62843140-b8ec-4625-b180-0cf2bab5498f is scheduled to L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d with binding_index 1 {{(pid=102446) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 20 05:56:35.342860 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58b9494f-371c-4a0e-9191-40e42da98064 req-767e095d-8d49-46c9-9701-d0d23fd6e3cb service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1050248 Dec 20 05:56:35.456059 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:56:35.460924 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58b9494f-371c-4a0e-9191-40e42da98064 req-6904ecf6-8308-4764-bbed-2762d0c4a1cd service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1075122 Dec 20 05:56:35.467494 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Sync routers for ids ['62843140-b8ec-4625-b180-0cf2bab5498f'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:56:35.485328 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] Publish callbacks [] for router, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:35.486683 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-732a27fb-2b11-4d19-a335-9510347da37e admin admin] 10.222.0.46 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 1.8616729 Dec 20 05:56:35.489726 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46798) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:35.505268 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Routers {'62843140-b8ec-4625-b180-0cf2bab5498f'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:56:35.505268 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:56:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['62843140-b8ec-4625-b180-0cf2bab5498f'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:35.511528 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-6fe5ef64-48e7-46d2-8d37-e49628afc940 None None] Provisioning complete for port f4176d81-24d2-4765-a3a7-586fd16e8f13 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:35.511905 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-6fe5ef64-48e7-46d2-8d37-e49628afc940 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:35.556963 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eabf36b1-db90-4b3a-b840-3784927be89a req-9b9ac9a3-9d42-4a20-94cd-a3b05bdc35dc tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:35.569265 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-eabf36b1-db90-4b3a-b840-3784927be89a req-9b9ac9a3-9d42-4a20-94cd-a3b05bdc35dc tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0668340 Dec 20 05:56:35.623500 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-6fe5ef64-48e7-46d2-8d37-e49628afc940 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:35.669503 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-6fe5ef64-48e7-46d2-8d37-e49628afc940 None None] For port f4176d81-24d2-4765-a3a7-586fd16e8f13, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=f4176d81-24d2-4765-a3a7-586fd16e8f13,segment=NetworkSegment(6a78353a-8122-4f87-a059-aadb4a3c82d5),segment_id=6a78353a-8122-4f87-a059-aadb4a3c82d5)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:56:35.676104 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-6fe5ef64-48e7-46d2-8d37-e49628afc940 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:35.680811 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-eabf36b1-db90-4b3a-b840-3784927be89a req-2a598e1d-3022-4873-91db-5801edbb400b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1060073 Dec 20 05:56:35.681356 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Set router 62843140-b8ec-4625-b180-0cf2bab5498f gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:56:35.755572 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fe5ef64-48e7-46d2-8d37-e49628afc940 None None] Pushing event updated for resources: {'Port': ['ID=f4176d81-24d2-4765-a3a7-586fd16e8f13,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:35.908890 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-51d41336-5dfa-4184-95f8-42ed8c56e65d None None] Provisioning complete for port f4176d81-24d2-4765-a3a7-586fd16e8f13 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:35.909557 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-51d41336-5dfa-4184-95f8-42ed8c56e65d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:35.937052 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device f4176d81-24d2-4765-a3a7-586fd16e8f13 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:35.985630 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69'}], 'enable_snat': True}, 'gw_port_id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:56:34Z', 'revision_number': 3, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port': {'id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:96:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 484, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:34Z', 'updated_at': '2021-12-20T05:56:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:36.018255 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port f4176d81-24d2-4765-a3a7-586fd16e8f13 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:36.018833 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.026140 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Checking router: 62843140-b8ec-4625-b180-0cf2bab5498f for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:56:36.026722 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Updating router 62843140-b8ec-4625-b180-0cf2bab5498f port e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc binding host dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:56:36.057558 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.058645 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e357a73-339a-45d7-a7a0-4e041441c301 req-bef41496-8c5a-44bc-ba30-41f1beca4032 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:36.060381 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2e357a73-339a-45d7-a7a0-4e041441c301 req-bef41496-8c5a-44bc-ba30-41f1beca4032 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.0576742 Dec 20 05:56:36.067524 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.133128 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2e357a73-339a-45d7-a7a0-4e041441c301 req-7ae53dfe-dba2-478e-9c1c-ecb686d155ab tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0644956 Dec 20 05:56:36.292607 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Allocated IP 172.20.0.1 (4e35b188-ad5c-4cae-9209-b7e538e3669f/fca5c9c5-06df-4c64-840c-e8558a30dd3c/526d693f-a680-4d0e-a26f-98f517a8db50) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:56:36.363102 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Publish callbacks [] for port, precommit_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.369704 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.417875 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.421834 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Attempting to bind port e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:56:36.422258 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Attempting to bind port e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:56:36.422493 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Attempting to bind port e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc on network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:56:36.425352 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87fc97a9-1af1-481d-a321-c974f4dc7b67 None None] Pushing event updated for resources: {'Port': ['ID=e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc,revision_number=2']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:36.429955 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 56, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:56:36.430322 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Checking segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102448) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:56:36.431306 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.432043 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Bound using segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:56:36.432172 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Bound port: e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:56:36.432553 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.459219 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.478357 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.483275 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] For port e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102448) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:56:36.486298 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] For port e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102448) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:56:36.491376 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.498398 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Network 4e35b188-ad5c-4cae-9209-b7e538e3669f is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:56:36.501334 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:36.504743 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:56:36.530598 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Pushing event updated for resources: {'Port': ['ID=526d693f-a680-4d0e-a26f-98f517a8db50,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:36.549671 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1703675'] for router_interface, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.555047 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87fc97a9-1af1-481d-a321-c974f4dc7b67 None None] Pushing event updated for resources: {'Port': ['ID=e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc,revision_number=3']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:36.559418 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Routers {'62843140-b8ec-4625-b180-0cf2bab5498f'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:56:36.560282 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:56:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['62843140-b8ec-4625-b180-0cf2bab5498f'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:36.687349 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] Set router 62843140-b8ec-4625-b180-0cf2bab5498f gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:56:36.689426 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.757972 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-607f5312-b3b5-4a62-be98-c78b556140bb None None] Provisioning complete for port 526d693f-a680-4d0e-a26f-98f517a8db50 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:36.758903 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-607f5312-b3b5-4a62-be98-c78b556140bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.805358 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-607f5312-b3b5-4a62-be98-c78b556140bb None None] Port 526d693f-a680-4d0e-a26f-98f517a8db50 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:56:36.821625 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6ba641-2c89-4895-bf2c-c34e89ab2191 req-7b6079f2-c83b-47eb-a924-b9c7089b9cdd tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:36.823177 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-de6ba641-2c89-4895-bf2c-c34e89ab2191 req-7b6079f2-c83b-47eb-a924-b9c7089b9cdd tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0573380 Dec 20 05:56:36.877824 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-de6ba641-2c89-4895-bf2c-c34e89ab2191 req-82a2186b-ec75-4eeb-9b16-9f210e9f5361 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470352 Dec 20 05:56:36.880488 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.888183 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69'}], 'enable_snat': True}, 'gw_port_id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:56:34Z', 'revision_number': 3, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port': {'id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:96:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 484, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:34Z', 'updated_at': '2021-12-20T05:56:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:36.891370 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.915564 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b47cac6-9b18-4b06-81f7-6c0df195443f None None] The sync data for ids ['62843140-b8ec-4625-b180-0cf2bab5498f'] in dv-cinder-822278-1-iscsi is: [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69'}], 'enable_snat': True}, 'gw_port_id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:56:34Z', 'revision_number': 3, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port': {'id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:96:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 484, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:34Z', 'updated_at': '2021-12-20T05:56:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:56:36.962134 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1617520', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1697131'] for router_interface, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:36.971746 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Pushing event updated for resources: {'Port': ['ID=526d693f-a680-4d0e-a26f-98f517a8db50,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:37.061758 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Network 4e35b188-ad5c-4cae-9209-b7e538e3669f is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:56:37.063089 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:37.209572 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Router 62843140-b8ec-4625-b180-0cf2bab5498f has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:56:37.296833 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d9a1de-66ea-4e33-b1bd-6ab14bf5fb1e req-1c8291ee-e9f9-49b8-9c99-75642d8bd10c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:37.302773 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a8d9a1de-66ea-4e33-b1bd-6ab14bf5fb1e req-1c8291ee-e9f9-49b8-9c99-75642d8bd10c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.0733378 Dec 20 05:56:37.331972 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-9d6b00ec-8729-4517-973b-0af9fd2cf6fe None None] Provisioning complete for port 526d693f-a680-4d0e-a26f-98f517a8db50 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:37.333003 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-9d6b00ec-8729-4517-973b-0af9fd2cf6fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:37.377582 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a8d9a1de-66ea-4e33-b1bd-6ab14bf5fb1e req-6111ce96-6743-4a6e-9432-ad8fab996b3c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0689981 Dec 20 05:56:37.382084 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-9d6b00ec-8729-4517-973b-0af9fd2cf6fe None None] Port 526d693f-a680-4d0e-a26f-98f517a8db50 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:56:37.384389 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:37.558009 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:56:37.572485 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-5881d8a0-136a-4dff-9a1b-c3af2af21103 admin admin] 10.222.0.46 "PUT /v2.0/routers/62843140-b8ec-4625-b180-0cf2bab5498f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0726981 Dec 20 05:56:37.585256 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:37.904465 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:37.969177 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:37.970151 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.053552 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9608d52-6631-4c36-bc9f-15e0b8267837 req-95edf89f-bd80-42ea-8958-6f1798339031 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:38.055037 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d9608d52-6631-4c36-bc9f-15e0b8267837 req-95edf89f-bd80-42ea-8958-6f1798339031 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.1027400 Dec 20 05:56:38.076257 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1d481c-697c-4963-95e1-b9ad6a521af3 req-313e24d5-e00d-4f41-ba63-e11f4d1f7a65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:38.077738 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1e1d481c-697c-4963-95e1-b9ad6a521af3 req-313e24d5-e00d-4f41-ba63-e11f4d1f7a65 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 1098 time: 0.0708156 Dec 20 05:56:38.077871 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.102660 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:56:38.109068 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.126102 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46832) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:38.131203 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-223794928-network', 'tenant_id': 'e5f5841978a84626b73369bafc92e612'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:38.147060 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d9608d52-6631-4c36-bc9f-15e0b8267837 req-f49c9176-1f24-403a-897f-a27deabf811f tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0824468 Dec 20 05:56:38.154909 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] Made reservation on behalf of e5f5841978a84626b73369bafc92e612 for: {'network': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:56:38.157693 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.169301 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1e1d481c-697c-4963-95e1-b9ad6a521af3 req-660eb203-1921-4c2e-b80a-a6dd4836ed0d service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0664098 Dec 20 05:56:38.172502 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.175467 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:38.252089 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.255909 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.282671 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] vlan segment allocate from pool success with {'vlan_id': 443, 'physical_network': 'physnet1'} {{(pid=102446) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:56:38.295478 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f86788c-75a6-4d42-a986-693f2f25a926,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:38.299488 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.299861 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.segments_db [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] Added segment 1ae7591b-9735-4985-905b-489b2e4c5d48 of type vlan for network 8c423773-73ba-4c57-a6d9-3e1edd7a4798 Dec 20 05:56:38.346280 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.375777 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.376724 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:38.377318 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.421784 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 46840) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:38.427702 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-e4958395-e94c-4855-ba62-8df11dfade9a admin admin] Request body: {'subnet': {'network_id': '8c423773-73ba-4c57-a6d9-3e1edd7a4798', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-223794928-subnet', 'tenant_id': 'e5f5841978a84626b73369bafc92e612', 'ip_version': 4}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:38.432350 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3049684 Dec 20 05:56:38.461518 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4958395-e94c-4855-ba62-8df11dfade9a admin admin] Made reservation on behalf of e5f5841978a84626b73369bafc92e612 for: {'subnet': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:56:38.464796 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e4958395-e94c-4855-ba62-8df11dfade9a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3597747'] for subnet, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.467191 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e28e018-26e2-4da5-97d6-87e84fea5699 admin admin] Pushing event updated for resources: {'Network': ['ID=8c423773-73ba-4c57-a6d9-3e1edd7a4798,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:38.479793 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network 8c423773-73ba-4c57-a6d9-3e1edd7a4798 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:56:38.624248 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28984718-818c-4ea0-aadb-6cc080f4245b req-3c765925-8392-41be-b235-2a036e824e79 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:38.625790 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-28984718-818c-4ea0-aadb-6cc080f4245b req-3c765925-8392-41be-b235-2a036e824e79 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.1124654 Dec 20 05:56:38.717554 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Sync routers for ids ['62843140-b8ec-4625-b180-0cf2bab5498f'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:56:38.728786 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Routers {'62843140-b8ec-4625-b180-0cf2bab5498f'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:56:38.729406 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:56:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['62843140-b8ec-4625-b180-0cf2bab5498f'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:38.742580 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-28984718-818c-4ea0-aadb-6cc080f4245b req-9a9a66c6-398a-4394-b9fa-462bdfab95ca tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1012366 Dec 20 05:56:38.765625 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e4958395-e94c-4855-ba62-8df11dfade9a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3457622', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3597789'] for subnet, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.819072 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4958395-e94c-4855-ba62-8df11dfade9a admin admin] Pushing event updated for resources: {'Subnet': ['ID=9b94b8c4-47a7-41ad-a245-a6b6ac0e356c,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:38.830000 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4958395-e94c-4855-ba62-8df11dfade9a admin admin] Checking segment: {'id': '1ae7591b-9735-4985-905b-489b2e4c5d48', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '8c423773-73ba-4c57-a6d9-3e1edd7a4798'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:56:38.830356 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4958395-e94c-4855-ba62-8df11dfade9a admin admin] Network hostable DHCP agents. Network: 8c423773-73ba-4c57-a6d9-3e1edd7a4798, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:56:38.841001 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Set router 62843140-b8ec-4625-b180-0cf2bab5498f gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:56:38.847143 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4958395-e94c-4855-ba62-8df11dfade9a admin admin] Network 8c423773-73ba-4c57-a6d9-3e1edd7a4798 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:56:38.855497 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-e4958395-e94c-4855-ba62-8df11dfade9a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, 8c423773-73ba-4c57-a6d9-3e1edd7a4798) {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:38.860409 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4958395-e94c-4855-ba62-8df11dfade9a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:38.861053 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e4958395-e94c-4855-ba62-8df11dfade9a admin admin] Publish callbacks [] for subnet, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.870548 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7aeadee-7f5d-4ca6-a885-8364c450e438 None None] Network 8c423773-73ba-4c57-a6d9-3e1edd7a4798 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:56:38.878784 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-e4958395-e94c-4855-ba62-8df11dfade9a admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.4558525 Dec 20 05:56:38.881277 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 46848) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:38.886005 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-223794928-router', 'tenant_id': 'e5f5841978a84626b73369bafc92e612', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:38.910126 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1698740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25959'] for router, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.911661 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1698340', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1703163', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1634740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25982'] for router, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:38.973277 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:39.065223 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf82c7edd-7168-52b9-b9ff-dee431eec71c-8c423773-73ba-4c57-a6d9-3e1edd7a4798', 'network_id': '8c423773-73ba-4c57-a6d9-3e1edd7a4798', 'project_id': 'e5f5841978a84626b73369bafc92e612', 'fixed_ips': [{'subnet_id': '9b94b8c4-47a7-41ad-a245-a6b6ac0e356c'}]}} from dv-cinder-822278-1-iscsi. {{(pid=102447) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 20 05:56:39.066081 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:39.108800 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:39.232439 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69'}], 'enable_snat': True}, 'gw_port_id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:56:36Z', 'revision_number': 4, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port': {'id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:96:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 484, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:34Z', 'updated_at': '2021-12-20T05:56:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '526d693f-a680-4d0e-a26f-98f517a8db50', 'name': '', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'tenant_id': '627c52664e194163a380283ded298eb5', 'mac_address': 'fa:16:3e:cb:78:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_interface', 'standard_attr_id': 485, 'fixed_ips': [{'subnet_id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:36Z', 'updated_at': '2021-12-20T05:56:36Z', 'revision_number': 2, 'project_id': '627c52664e194163a380283ded298eb5', 'subnets': [{'id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:39.267296 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Checking router: 62843140-b8ec-4625-b180-0cf2bab5498f for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:56:39.267683 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Updating router 62843140-b8ec-4625-b180-0cf2bab5498f port 526d693f-a680-4d0e-a26f-98f517a8db50 binding host dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:56:39.272989 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.db_base_plugin_common [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Allocated IP 172.20.0.2 (8c423773-73ba-4c57-a6d9-3e1edd7a4798/9b94b8c4-47a7-41ad-a245-a6b6ac0e356c/c6e563a3-8b01-4d5b-9e43-dcb1c258ac59) {{(pid=102447) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:56:39.304719 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:39.347950 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00265f5-4e21-44be-868a-111b552722d7 req-7a2d809d-5c6a-4e67-94c5-ff2d6aedb34e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:39.349378 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e00265f5-4e21-44be-868a-111b552722d7 req-7a2d809d-5c6a-4e67-94c5-ff2d6aedb34e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.1106586 Dec 20 05:56:39.355403 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:39.385921 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:39.460569 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e00265f5-4e21-44be-868a-111b552722d7 req-a9e7c59d-8537-4f34-96a4-2aa576898588 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1031351 Dec 20 05:56:39.516731 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Allocated IP 172.27.3.6 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/a343b7af-610a-4366-8d53-65e7d17efd82) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:56:39.589021 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Publish callbacks [] for port, precommit_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:39.600393 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:39.643349 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:39.662744 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Network 8c423773-73ba-4c57-a6d9-3e1edd7a4798 is already hosted by enough agents. {{(pid=102447) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:56:39.669420 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.base_scheduler [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Resources bound (agent type, host, resource id): {{(pid=102447) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:39.677762 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Received port after_create {{(pid=102447) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:56:39.679030 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:39.687774 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Pushing event updated for resources: {'Port': ['ID=c6e563a3-8b01-4d5b-9e43-dcb1c258ac59,revision_number=1']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:39.719210 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:56:39.722398 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:39.726730 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:56:39.802968 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Pushing event updated for resources: {'Port': ['ID=a343b7af-610a-4366-8d53-65e7d17efd82,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:39.896484 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Publish callbacks [] for port, precommit_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:39.902886 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:39.906247 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Attempting to bind port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:56:39.906619 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Attempting to bind port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '1ae7591b-9735-4985-905b-489b2e4c5d48', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '8c423773-73ba-4c57-a6d9-3e1edd7a4798'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:56:39.907027 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Attempting to bind port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 on network 8c423773-73ba-4c57-a6d9-3e1edd7a4798 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:56:39.930541 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:39.938030 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 8a9f4386-7528-40a4-9b44-826be10f5c21 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:56:39.948695 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 56, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:56:39.949076 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Checking segment: {'id': '1ae7591b-9735-4985-905b-489b2e4c5d48', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '8c423773-73ba-4c57-a6d9-3e1edd7a4798'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:56:39.949475 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:39.949867 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Bound using segment: {'id': '1ae7591b-9735-4985-905b-489b2e4c5d48', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '8c423773-73ba-4c57-a6d9-3e1edd7a4798'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:56:39.950347 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Bound port: c6e563a3-8b01-4d5b-9e43-dcb1c258ac59, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1ae7591b-9735-4985-905b-489b2e4c5d48', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '8c423773-73ba-4c57-a6d9-3e1edd7a4798'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:56:39.950731 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:39.965877 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde68b1d-1bb7-4258-ae2a-3cff50ae9259 req-7564b2dd-e1cd-4970-9e71-cfda3d2c138b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:39.967559 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fde68b1d-1bb7-4258-ae2a-3cff50ae9259 req-7564b2dd-e1cd-4970-9e71-cfda3d2c138b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.1168656 Dec 20 05:56:40.052548 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a51c045-3edd-4c00-81d2-648512479c6d None None] Pushing event updated for resources: {'Port': ['ID=526d693f-a680-4d0e-a26f-98f517a8db50,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:40.113315 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fde68b1d-1bb7-4258-ae2a-3cff50ae9259 req-48e5c74f-d290-4f78-b30a-19968b209473 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1345944 Dec 20 05:56:40.135018 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:40.165694 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:40.166066 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:40.215464 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] For port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:56:40.235020 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Attempting to bind port 526d693f-a680-4d0e-a26f-98f517a8db50 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:56:40.235424 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Attempting to bind port 526d693f-a680-4d0e-a26f-98f517a8db50 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '6a78353a-8122-4f87-a059-aadb4a3c82d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:56:40.235810 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Attempting to bind port 526d693f-a680-4d0e-a26f-98f517a8db50 on network 4e35b188-ad5c-4cae-9209-b7e538e3669f {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:56:40.243007 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] For port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=c6e563a3-8b01-4d5b-9e43-dcb1c258ac59,segment=NetworkSegment(1ae7591b-9735-4985-905b-489b2e4c5d48),segment_id=1ae7591b-9735-4985-905b-489b2e4c5d48)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:56:40.255657 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:40.263586 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 56, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:56:40.263965 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Checking segment: {'id': '6a78353a-8122-4f87-a059-aadb4a3c82d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:56:40.264370 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:40.264764 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Bound using segment: {'id': '6a78353a-8122-4f87-a059-aadb4a3c82d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:56:40.265245 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Bound port: 526d693f-a680-4d0e-a26f-98f517a8db50, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6a78353a-8122-4f87-a059-aadb4a3c82d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:56:40.265620 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:40.270064 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 8a9f4386-7528-40a4-9b44-826be10f5c21, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=8a9f4386-7528-40a4-9b44-826be10f5c21,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:56:40.323197 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'port_id': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'mac_address': 'fa:16:3e:ec:ca:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 407, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:56:40.453631 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1182c7c-cf1c-49b3-9a6b-31564239ee55 None None] Pushing event updated for resources: {'Port': ['ID=c6e563a3-8b01-4d5b-9e43-dcb1c258ac59,revision_number=2']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:40.470981 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-95928419-c382-4d8e-b622-03d880ee9bfd None None] Provisioning complete for port 526d693f-a680-4d0e-a26f-98f517a8db50 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:40.471354 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-95928419-c382-4d8e-b622-03d880ee9bfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:40.472905 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:40.516252 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] For port 526d693f-a680-4d0e-a26f-98f517a8db50, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:56:40.527653 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8a9f4386-7528-40a4-9b44-826be10f5c21 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:56:40.561514 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] For port 526d693f-a680-4d0e-a26f-98f517a8db50, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=526d693f-a680-4d0e-a26f-98f517a8db50,segment=NetworkSegment(6a78353a-8122-4f87-a059-aadb4a3c82d5),segment_id=6a78353a-8122-4f87-a059-aadb4a3c82d5)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:56:40.575891 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-95928419-c382-4d8e-b622-03d880ee9bfd None None] Port 526d693f-a680-4d0e-a26f-98f517a8db50 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:56:40.581089 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:40.584376 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 8a9f4386-7528-40a4-9b44-826be10f5c21, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=8a9f4386-7528-40a4-9b44-826be10f5c21,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:56:40.601354 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1698355', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1703078'] for router, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:40.616444 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:40.659068 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Routers {'62843140-b8ec-4625-b180-0cf2bab5498f'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:56:40.660125 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:56:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['62843140-b8ec-4625-b180-0cf2bab5498f'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:40.663811 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a51c045-3edd-4c00-81d2-648512479c6d None None] Pushing event updated for resources: {'Port': ['ID=526d693f-a680-4d0e-a26f-98f517a8db50,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:40.726154 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee690ce-34ee-41ea-bf35-ab8829b60a97 req-23d2ceca-be27-4809-9208-6f4acb59fd64 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:40.728397 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dee690ce-34ee-41ea-bf35-ab8829b60a97 req-23d2ceca-be27-4809-9208-6f4acb59fd64 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.1453607 Dec 20 05:56:40.832062 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dee690ce-34ee-41ea-bf35-ab8829b60a97 req-7689669b-6726-4071-87ce-694eac381cb6 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710967 Dec 20 05:56:40.851473 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] Set router 62843140-b8ec-4625-b180-0cf2bab5498f gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:56:40.872333 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Router b6b6dd20-1b3b-4679-8eac-12000f450db9 is scheduled to L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d with binding_index 1 {{(pid=102445) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 20 05:56:40.887466 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=8a9f4386-7528-40a4-9b44-826be10f5c21,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:41.038227 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:56:41.041165 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-9c87f77e-ffea-4829-801b-f99fe5fe5e10 None None] Provisioning complete for port 526d693f-a680-4d0e-a26f-98f517a8db50 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:41.041165 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-9c87f77e-ffea-4829-801b-f99fe5fe5e10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:41.054694 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Sync routers for ids ['b6b6dd20-1b3b-4679-8eac-12000f450db9'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:56:41.061610 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] Publish callbacks [] for router, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:41.063361 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-ef57632b-e3b9-49a3-be6f-1f6af938f6bf admin admin] 10.222.0.46 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 2.1809022 Dec 20 05:56:41.066361 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46870) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:41.078237 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Routers {'b6b6dd20-1b3b-4679-8eac-12000f450db9'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:56:41.079657 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:56:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['b6b6dd20-1b3b-4679-8eac-12000f450db9'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:41.090114 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['8a9f4386-7528-40a4-9b44-826be10f5c21'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:56:41.275337 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ab81962-fc8f-4933-88c7-77a36df5402e req-743c7d6b-b228-4a84-bf3f-41133dc936b8 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:41.285285 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Set router b6b6dd20-1b3b-4679-8eac-12000f450db9 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:56:41.290540 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3ab81962-fc8f-4933-88c7-77a36df5402e req-743c7d6b-b228-4a84-bf3f-41133dc936b8 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.1484559 Dec 20 05:56:41.295348 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69'}], 'enable_snat': True}, 'gw_port_id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:56:36Z', 'revision_number': 4, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port': {'id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:96:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 484, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:34Z', 'updated_at': '2021-12-20T05:56:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '526d693f-a680-4d0e-a26f-98f517a8db50', 'name': '', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'tenant_id': '627c52664e194163a380283ded298eb5', 'mac_address': 'fa:16:3e:cb:78:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_interface', 'standard_attr_id': 485, 'fixed_ips': [{'subnet_id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:36Z', 'updated_at': '2021-12-20T05:56:40Z', 'revision_number': 4, 'project_id': '627c52664e194163a380283ded298eb5', 'subnets': [{'id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:41.301491 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-9c87f77e-ffea-4829-801b-f99fe5fe5e10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:41.371095 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-446d281c-7198-476d-b712-82c5fc21bf09 None None] The sync data for ids ['62843140-b8ec-4625-b180-0cf2bab5498f'] in dv-cinder-822278-1-iscsi is: [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69'}], 'enable_snat': True}, 'gw_port_id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:56:36Z', 'revision_number': 4, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port': {'id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:96:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 484, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:34Z', 'updated_at': '2021-12-20T05:56:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '526d693f-a680-4d0e-a26f-98f517a8db50', 'name': '', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'tenant_id': '627c52664e194163a380283ded298eb5', 'mac_address': 'fa:16:3e:cb:78:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_interface', 'standard_attr_id': 485, 'fixed_ips': [{'subnet_id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:36Z', 'updated_at': '2021-12-20T05:56:40Z', 'revision_number': 4, 'project_id': '627c52664e194163a380283ded298eb5', 'subnets': [{'id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:56:41.428691 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-9c87f77e-ffea-4829-801b-f99fe5fe5e10 None None] For port 526d693f-a680-4d0e-a26f-98f517a8db50, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=526d693f-a680-4d0e-a26f-98f517a8db50,segment=NetworkSegment(6a78353a-8122-4f87-a059-aadb4a3c82d5),segment_id=6a78353a-8122-4f87-a059-aadb4a3c82d5)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:56:41.439951 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-9c87f77e-ffea-4829-801b-f99fe5fe5e10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:41.495696 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3ab81962-fc8f-4933-88c7-77a36df5402e req-fef15bf9-4b23-47ba-8abd-22e78d68e360 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2029953 Dec 20 05:56:41.536867 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5c18e95-4218-4af0-841a-280be6a8e343 req-928b8f95-413f-4ce9-b326-a04e311e8025 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:41.541584 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d5c18e95-4218-4af0-841a-280be6a8e343 req-928b8f95-413f-4ce9-b326-a04e311e8025 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a2e9de0d64e642f08bf90d402e77baa3&device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 1098 time: 0.3064663 Dec 20 05:56:41.557081 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a8a2ec6-e8d9-4833-bc0d-6532c3cb45e8 req-ef6f6c78-0842-453f-ad59-284caea5dc49 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:41.565216 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3a8a2ec6-e8d9-4833-bc0d-6532c3cb45e8 req-ef6f6c78-0842-453f-ad59-284caea5dc49 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.2641501 Dec 20 05:56:41.574818 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c87f77e-ffea-4829-801b-f99fe5fe5e10 None None] Pushing event updated for resources: {'Port': ['ID=526d693f-a680-4d0e-a26f-98f517a8db50,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:41.776492 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'name': 'tempest-TestMinimumBasicScenario-223794928-router', 'tenant_id': 'e5f5841978a84626b73369bafc92e612', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': 'a343b7af-610a-4366-8d53-65e7d17efd82', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:38Z', 'updated_at': '2021-12-20T05:56:39Z', 'revision_number': 3, 'project_id': 'e5f5841978a84626b73369bafc92e612', 'gw_port': {'id': 'a343b7af-610a-4366-8d53-65e7d17efd82', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:14:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 496, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:39Z', 'updated_at': '2021-12-20T05:56:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:41.806263 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Checking router: b6b6dd20-1b3b-4679-8eac-12000f450db9 for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:56:41.806616 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Updating router b6b6dd20-1b3b-4679-8eac-12000f450db9 port a343b7af-610a-4366-8d53-65e7d17efd82 binding host dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:56:41.852967 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:41.856095 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3a8a2ec6-e8d9-4833-bc0d-6532c3cb45e8 req-535e420f-3010-4147-89f8-672c0e2ebe79 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2860825 Dec 20 05:56:41.877795 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5c18e95-4218-4af0-841a-280be6a8e343 req-45feff78-3ee1-44db-951e-630c163f7cf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:41.879293 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d5c18e95-4218-4af0-841a-280be6a8e343 req-45feff78-3ee1-44db-951e-630c163f7cf3 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a HTTP/1.1" status: 200 len: 920 time: 0.3030396 Dec 20 05:56:41.896322 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bece4675-900e-4040-ac0c-9d61373fb027 None None] Network 8c423773-73ba-4c57-a6d9-3e1edd7a4798 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:56:42.002976 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694765cc-756f-48c8-a0fe-7f4a7c8eb5ab req-463c6a97-e68a-42dc-a496-5d5a95b4f7f2 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:42.004652 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-694765cc-756f-48c8-a0fe-7f4a7c8eb5ab req-463c6a97-e68a-42dc-a496-5d5a95b4f7f2 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 944 time: 0.3644657 Dec 20 05:56:42.005967 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d5c18e95-4218-4af0-841a-280be6a8e343 req-a29cab7a-0e88-4418-8f23-4428b9eff7d2 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 HTTP/1.1" status: 200 len: 217 time: 0.1169682 Dec 20 05:56:42.070265 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.106889 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 526d693f-a680-4d0e-a26f-98f517a8db50 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:42.116210 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-694765cc-756f-48c8-a0fe-7f4a7c8eb5ab req-810637c3-b32a-4336-8c82-2199b03021ca tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1046412 Dec 20 05:56:42.118420 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5c18e95-4218-4af0-841a-280be6a8e343 req-af3f268d-78fd-4814-876c-472891a0dd20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:42.119835 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d5c18e95-4218-4af0-841a-280be6a8e343 req-af3f268d-78fd-4814-876c-472891a0dd20 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=e1658c3d-4c2e-4687-a529-637456d3a81c HTTP/1.1" status: 200 len: 859 time: 0.0972500 Dec 20 05:56:42.171389 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d5c18e95-4218-4af0-841a-280be6a8e343 req-44e4666d-96af-4b86-97bd-ed3684ffbfb0 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0403140 Dec 20 05:56:42.173888 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-bc4f2b31-8180-4338-8358-8a8e5b4894d6 None None] Provisioning complete for port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:42.174258 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-bc4f2b31-8180-4338-8358-8a8e5b4894d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.252705 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Publish callbacks [] for port, precommit_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.259605 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Allocated IP 172.20.0.1 (8c423773-73ba-4c57-a6d9-3e1edd7a4798/9b94b8c4-47a7-41ad-a245-a6b6ac0e356c/0fdb5ab3-ae47-4202-a1e2-fe074e8b5730) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:56:42.266120 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.297960 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d5c18e95-4218-4af0-841a-280be6a8e343 req-4d36596c-8093-4af5-ad5d-ce4a76ccb68c service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1169035 Dec 20 05:56:42.332086 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Attempting to bind port a343b7af-610a-4366-8d53-65e7d17efd82 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:56:42.332457 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Attempting to bind port a343b7af-610a-4366-8d53-65e7d17efd82 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:56:42.333010 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Attempting to bind port a343b7af-610a-4366-8d53-65e7d17efd82 on network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:56:42.337044 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f7f544-2b8f-4603-ac29-e864c25cde4a None None] Pushing event updated for resources: {'Port': ['ID=a343b7af-610a-4366-8d53-65e7d17efd82,revision_number=2']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:42.361522 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 56, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:56:42.361901 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Checking segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102448) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:56:42.362312 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.362709 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Bound using segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:56:42.363201 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Bound port: a343b7af-610a-4366-8d53-65e7d17efd82, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:56:42.364178 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.439084 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.439661 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d5c18e95-4218-4af0-841a-280be6a8e343 req-095d675e-d71c-42f0-9063-c852ad05e076 service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1272647 Dec 20 05:56:42.452297 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] For port a343b7af-610a-4366-8d53-65e7d17efd82, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102448) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:56:42.457619 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] For port a343b7af-610a-4366-8d53-65e7d17efd82, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=a343b7af-610a-4366-8d53-65e7d17efd82,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102448) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:56:42.465198 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.501028 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.517838 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 526d693f-a680-4d0e-a26f-98f517a8db50 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:42.518210 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.560065 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Network 8c423773-73ba-4c57-a6d9-3e1edd7a4798 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:56:42.565842 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:42.568700 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Pushing event updated for resources: {'Port': ['ID=0fdb5ab3-ae47-4202-a1e2-fe074e8b5730,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:42.571945 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:56:42.606399 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Routers {'b6b6dd20-1b3b-4679-8eac-12000f450db9'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:56:42.607628 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:56:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['b6b6dd20-1b3b-4679-8eac-12000f450db9'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:42.618951 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1703675'] for router_interface, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.640214 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-bc4f2b31-8180-4338-8358-8a8e5b4894d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.727861 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f7f544-2b8f-4603-ac29-e864c25cde4a None None] Pushing event updated for resources: {'Port': ['ID=a343b7af-610a-4366-8d53-65e7d17efd82,revision_number=3']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:42.741588 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-359bb7cd-2d6f-493d-8bfa-86e41313cbaf req-f9068523-eb27-4c3a-b0ed-a1b5a8202f33 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:42.744488 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-359bb7cd-2d6f-493d-8bfa-86e41313cbaf req-f9068523-eb27-4c3a-b0ed-a1b5a8202f33 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0991578 Dec 20 05:56:42.748187 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-bc4f2b31-8180-4338-8358-8a8e5b4894d6 None None] For port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=c6e563a3-8b01-4d5b-9e43-dcb1c258ac59,segment=NetworkSegment(1ae7591b-9735-4985-905b-489b2e4c5d48),segment_id=1ae7591b-9735-4985-905b-489b2e4c5d48)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:56:42.759366 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:42.761433 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-bc4f2b31-8180-4338-8358-8a8e5b4894d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.860678 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-359bb7cd-2d6f-493d-8bfa-86e41313cbaf req-f6d28f39-4d49-481f-956f-1ceafe05f822 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1049776 Dec 20 05:56:42.893276 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.911846 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc4f2b31-8180-4338-8358-8a8e5b4894d6 None None] Pushing event updated for resources: {'Port': ['ID=c6e563a3-8b01-4d5b-9e43-dcb1c258ac59,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:42.920271 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:42.920643 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:42.923268 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] Set router b6b6dd20-1b3b-4679-8eac-12000f450db9 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:56:43.036831 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-5470f5b2-5528-488d-bbf0-17b415914c16 None None] Provisioning complete for port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:43.037214 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-5470f5b2-5528-488d-bbf0-17b415914c16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:43.098261 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3b331f6-7582-4368-8260-7eda1be2baa1 req-3e312fb1-9c21-4cc5-a013-acede82c84ae tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:43.101057 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f3b331f6-7582-4368-8260-7eda1be2baa1 req-3e312fb1-9c21-4cc5-a013-acede82c84ae tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.1052215 Dec 20 05:56:43.233351 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f3b331f6-7582-4368-8260-7eda1be2baa1 req-f7736512-0702-4827-b863-5b9ec064ed3d tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1122155 Dec 20 05:56:43.296902 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:43.303578 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:43.337507 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49f83bb9-c3eb-4dff-a2a9-0a646c073735 req-32fb5c76-edb5-4808-a538-8019d7463bcd tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:43.339946 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-49f83bb9-c3eb-4dff-a2a9-0a646c073735 req-32fb5c76-edb5-4808-a538-8019d7463bcd tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 944 time: 0.0892305 Dec 20 05:56:43.382756 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1617520', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1697131'] for router_interface, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:43.387957 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Pushing event updated for resources: {'Port': ['ID=0fdb5ab3-ae47-4202-a1e2-fe074e8b5730,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:43.409087 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-49f83bb9-c3eb-4dff-a2a9-0a646c073735 req-41892e79-2d2c-4316-ba37-dbb2b89cb91d tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0624950 Dec 20 05:56:43.412439 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-02e0baf3-afdf-418e-9183-9c9d62ef22b7 None None] Provisioning complete for port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:43.412814 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-02e0baf3-afdf-418e-9183-9c9d62ef22b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:43.421203 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'name': 'tempest-TestMinimumBasicScenario-223794928-router', 'tenant_id': 'e5f5841978a84626b73369bafc92e612', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': 'a343b7af-610a-4366-8d53-65e7d17efd82', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:38Z', 'updated_at': '2021-12-20T05:56:39Z', 'revision_number': 3, 'project_id': 'e5f5841978a84626b73369bafc92e612', 'gw_port': {'id': 'a343b7af-610a-4366-8d53-65e7d17efd82', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:14:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 496, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:39Z', 'updated_at': '2021-12-20T05:56:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:43.456302 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-02e0baf3-afdf-418e-9183-9c9d62ef22b7 None None] Port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:56:43.457665 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecb23920-158b-4f01-955b-8d18e23b8783 None None] The sync data for ids ['b6b6dd20-1b3b-4679-8eac-12000f450db9'] in dv-cinder-822278-1-iscsi is: [{'id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'name': 'tempest-TestMinimumBasicScenario-223794928-router', 'tenant_id': 'e5f5841978a84626b73369bafc92e612', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': 'a343b7af-610a-4366-8d53-65e7d17efd82', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:38Z', 'updated_at': '2021-12-20T05:56:39Z', 'revision_number': 3, 'project_id': 'e5f5841978a84626b73369bafc92e612', 'gw_port': {'id': 'a343b7af-610a-4366-8d53-65e7d17efd82', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:14:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 496, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:39Z', 'updated_at': '2021-12-20T05:56:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:56:43.517308 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Network 8c423773-73ba-4c57-a6d9-3e1edd7a4798 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:56:43.518754 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:43.645584 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Router b6b6dd20-1b3b-4679-8eac-12000f450db9 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:56:43.780248 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-6f9a6c13-4043-4be8-84d0-852ee9051fb4 None None] Provisioning complete for port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:43.780793 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-6f9a6c13-4043-4be8-84d0-852ee9051fb4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:43.782167 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:56:43.787684 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-519377de-9a90-4490-9d6d-ef3c5a1d95b3 admin admin] 10.222.0.46 "PUT /v2.0/routers/b6b6dd20-1b3b-4679-8eac-12000f450db9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7200613 Dec 20 05:56:43.829495 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-6f9a6c13-4043-4be8-84d0-852ee9051fb4 None None] Port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:56:43.956590 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 8a9f4386-7528-40a4-9b44-826be10f5c21 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:44.052844 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a55acc3-238e-4c37-af7c-cb7bfc750a30 req-6fb13b7a-8d7b-4173-b809-0cbb0fb096fa tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:44.053449 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device a343b7af-610a-4366-8d53-65e7d17efd82 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:44.054485 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0a55acc3-238e-4c37-af7c-cb7bfc750a30 req-6fb13b7a-8d7b-4173-b809-0cbb0fb096fa tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.1018989 Dec 20 05:56:44.081013 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port 8a9f4386-7528-40a4-9b44-826be10f5c21 completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 05:56:44.086689 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 8a9f4386-7528-40a4-9b44-826be10f5c21 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:44.087068 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:44.114872 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0a55acc3-238e-4c37-af7c-cb7bfc750a30 req-8860fc57-86c2-413e-920e-b728c4b2ff69 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471249 Dec 20 05:56:44.155693 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port a343b7af-610a-4366-8d53-65e7d17efd82 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:44.155935 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:44.226466 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:44.257641 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a9f4386-7528-40a4-9b44-826be10f5c21'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:56:44.260097 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5f1dc99f-2ed3-4002-9029-44f42869655a" -d '{"events": [{"server_uuid": "7f092569-f7b1-4e5d-859b-95ab2173d63f", "name": "network-vif-plugged", "status": "completed", "tag": "8a9f4386-7528-40a4-9b44-826be10f5c21"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:56:44.301578 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 8a9f4386-7528-40a4-9b44-826be10f5c21, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=8a9f4386-7528-40a4-9b44-826be10f5c21,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:56:44.308497 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:44.335824 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:44.352235 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:56:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4378ce74-445d-469c-8524-eeba9764f155 x-openstack-request-id: req-4378ce74-445d-469c-8524-eeba9764f155 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:56:44.352546 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7f092569-f7b1-4e5d-859b-95ab2173d63f", "name": "network-vif-plugged", "status": "completed", "tag": "8a9f4386-7528-40a4-9b44-826be10f5c21", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:56:44.352805 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-4378ce74-445d-469c-8524-eeba9764f155 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:56:44.353196 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'code': 200} Dec 20 05:56:44.373067 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port a343b7af-610a-4366-8d53-65e7d17efd82, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=a343b7af-610a-4366-8d53-65e7d17efd82,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:56:44.381049 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:44.381835 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:44.387361 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=8a9f4386-7528-40a4-9b44-826be10f5c21,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:44.444772 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ca3bea-4414-45af-b444-89b9bec042fd req-78495f8b-e8b4-4e3f-9410-a1c7b0dc357f tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:44.447192 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-45ca3bea-4414-45af-b444-89b9bec042fd req-78495f8b-e8b4-4e3f-9410-a1c7b0dc357f tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0860293 Dec 20 05:56:44.485308 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=a343b7af-610a-4366-8d53-65e7d17efd82,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:44.492761 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:44.493094 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:44.511707 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-45ca3bea-4414-45af-b444-89b9bec042fd req-5f356c67-56c3-4e1f-aea5-ad37a569cd7a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563731 Dec 20 05:56:44.623062 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10aa4906-948b-4732-9e7f-ac28c51459c2 req-ba16ca1a-a99b-4893-81ed-697be0f79746 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:44.625566 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-10aa4906-948b-4732-9e7f-ac28c51459c2 req-ba16ca1a-a99b-4893-81ed-697be0f79746 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0610671 Dec 20 05:56:44.746373 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-10aa4906-948b-4732-9e7f-ac28c51459c2 req-a4548dea-2172-4de4-b6f3-5c05e0aa76f8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1142635 Dec 20 05:56:44.814918 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2676138-bea1-4a6f-b90f-187eda9ea646 req-6e9441d2-c9ad-4a91-88ad-55a8ae81f212 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:44.817125 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e2676138-bea1-4a6f-b90f-187eda9ea646 req-6e9441d2-c9ad-4a91-88ad-55a8ae81f212 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 1098 time: 0.0687995 Dec 20 05:56:44.877543 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e2676138-bea1-4a6f-b90f-187eda9ea646 req-fe028306-03af-4f11-9549-4b8468a19725 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494409 Dec 20 05:56:45.276584 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b7161a-3dba-457a-a085-395d6bdc3755 req-9c8af7b8-cd2a-4283-a99a-bde31fbf771f tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:45.279221 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a8b7161a-3dba-457a-a085-395d6bdc3755 req-9c8af7b8-cd2a-4283-a99a-bde31fbf771f tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0710216 Dec 20 05:56:45.343127 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a8b7161a-3dba-457a-a085-395d6bdc3755 req-aa5a920c-df03-473a-b5fe-689cd2108fb5 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0544577 Dec 20 05:56:45.488282 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Sync routers for ids ['b6b6dd20-1b3b-4679-8eac-12000f450db9'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:56:45.501295 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Routers {'b6b6dd20-1b3b-4679-8eac-12000f450db9'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:56:45.502015 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:56:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['b6b6dd20-1b3b-4679-8eac-12000f450db9'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:45.718498 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Set router b6b6dd20-1b3b-4679-8eac-12000f450db9 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:56:45.718849 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e24987f5-b8ee-4c55-950b-f2aec32f5519 req-b2ddb13d-fde9-47e0-9041-f149044c4630 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:45.721843 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e24987f5-b8ee-4c55-950b-f2aec32f5519 req-b2ddb13d-fde9-47e0-9041-f149044c4630 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.1225929 Dec 20 05:56:45.826747 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e24987f5-b8ee-4c55-950b-f2aec32f5519 req-f4efac90-4ec2-425c-b8eb-7f968d1295ae tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1025400 Dec 20 05:56:45.967238 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4bf9b1f-91e5-48cf-bd77-8f3a146ff448 req-bb2deea8-7461-4aba-b3e0-85626de6f60d tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:45.969427 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e4bf9b1f-91e5-48cf-bd77-8f3a146ff448 req-bb2deea8-7461-4aba-b3e0-85626de6f60d tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0911841 Dec 20 05:56:45.982938 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device a343b7af-610a-4366-8d53-65e7d17efd82 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:46.061982 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e4bf9b1f-91e5-48cf-bd77-8f3a146ff448 req-95667328-c5cd-450f-99f3-9e7a9d396ee0 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0829365 Dec 20 05:56:46.146239 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port a343b7af-610a-4366-8d53-65e7d17efd82 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:46.146614 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:46.263484 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'name': 'tempest-TestMinimumBasicScenario-223794928-router', 'tenant_id': 'e5f5841978a84626b73369bafc92e612', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': 'a343b7af-610a-4366-8d53-65e7d17efd82', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:38Z', 'updated_at': '2021-12-20T05:56:42Z', 'revision_number': 4, 'project_id': 'e5f5841978a84626b73369bafc92e612', 'gw_port': {'id': 'a343b7af-610a-4366-8d53-65e7d17efd82', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:14:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 496, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:39Z', 'updated_at': '2021-12-20T05:56:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '0fdb5ab3-ae47-4202-a1e2-fe074e8b5730', 'name': '', 'network_id': '8c423773-73ba-4c57-a6d9-3e1edd7a4798', 'tenant_id': 'e5f5841978a84626b73369bafc92e612', 'mac_address': 'fa:16:3e:f8:55:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'device_owner': 'network:router_interface', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': '9b94b8c4-47a7-41ad-a245-a6b6ac0e356c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:42Z', 'updated_at': '2021-12-20T05:56:43Z', 'revision_number': 2, 'project_id': 'e5f5841978a84626b73369bafc92e612', 'subnets': [{'id': '9b94b8c4-47a7-41ad-a245-a6b6ac0e356c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:46.302148 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Checking router: b6b6dd20-1b3b-4679-8eac-12000f450db9 for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:56:46.302148 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Updating router b6b6dd20-1b3b-4679-8eac-12000f450db9 port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 binding host dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:56:46.343214 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:46.529904 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491558e5-8943-4d33-892c-ac2ba2eb3143 req-d45c0f0f-f30b-41ce-8347-2a80b8e521b4 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:46.531320 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-491558e5-8943-4d33-892c-ac2ba2eb3143 req-d45c0f0f-f30b-41ce-8347-2a80b8e521b4 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0553432 Dec 20 05:56:46.597845 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-491558e5-8943-4d33-892c-ac2ba2eb3143 req-2b56f89a-9d79-4034-bcb1-9f00a7111b64 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0541024 Dec 20 05:56:46.667269 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Publish callbacks [] for port, precommit_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:46.674854 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:46.727475 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-878b7363-fc1b-4ef9-96dd-f753f0136542 None None] Pushing event updated for resources: {'Port': ['ID=0fdb5ab3-ae47-4202-a1e2-fe074e8b5730,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:46.790346 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Attempting to bind port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:56:46.790724 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Attempting to bind port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '1ae7591b-9735-4985-905b-489b2e4c5d48', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '8c423773-73ba-4c57-a6d9-3e1edd7a4798'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:56:46.791254 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Attempting to bind port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 on network 8c423773-73ba-4c57-a6d9-3e1edd7a4798 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:56:46.808695 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 56, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:56:46.809203 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Checking segment: {'id': '1ae7591b-9735-4985-905b-489b2e4c5d48', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '8c423773-73ba-4c57-a6d9-3e1edd7a4798'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:56:46.809594 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:46.810036 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Bound using segment: {'id': '1ae7591b-9735-4985-905b-489b2e4c5d48', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '8c423773-73ba-4c57-a6d9-3e1edd7a4798'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:56:46.810516 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Bound port: 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1ae7591b-9735-4985-905b-489b2e4c5d48', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '8c423773-73ba-4c57-a6d9-3e1edd7a4798'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:56:46.810889 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:46.896610 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] For port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:56:46.900849 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] For port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=0fdb5ab3-ae47-4202-a1e2-fe074e8b5730,segment=NetworkSegment(1ae7591b-9735-4985-905b-489b2e4c5d48),segment_id=1ae7591b-9735-4985-905b-489b2e4c5d48)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:56:46.905084 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:46.970106 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Routers {'b6b6dd20-1b3b-4679-8eac-12000f450db9'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:56:46.970793 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:56:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['b6b6dd20-1b3b-4679-8eac-12000f450db9'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:46.972687 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-878b7363-fc1b-4ef9-96dd-f753f0136542 None None] Pushing event updated for resources: {'Port': ['ID=0fdb5ab3-ae47-4202-a1e2-fe074e8b5730,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:47.132558 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-e3c798c7-cc1f-4677-8785-b79ce235cad3 None None] Provisioning complete for port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:47.132929 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-e3c798c7-cc1f-4677-8785-b79ce235cad3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:47.204852 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] Set router b6b6dd20-1b3b-4679-8eac-12000f450db9 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:56:47.229317 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7801ff57-f052-4609-935f-be7071e25f33 req-28f979df-740d-446b-813c-9cca6a1dd28d tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:47.231238 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7801ff57-f052-4609-935f-be7071e25f33 req-28f979df-740d-446b-813c-9cca6a1dd28d tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0815423 Dec 20 05:56:47.302899 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7801ff57-f052-4609-935f-be7071e25f33 req-1da758f0-51fc-4f06-80f4-d1ed91d883ab tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0590961 Dec 20 05:56:47.425191 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-e3c798c7-cc1f-4677-8785-b79ce235cad3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:47.498017 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-e3c798c7-cc1f-4677-8785-b79ce235cad3 None None] For port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=0fdb5ab3-ae47-4202-a1e2-fe074e8b5730,segment=NetworkSegment(1ae7591b-9735-4985-905b-489b2e4c5d48),segment_id=1ae7591b-9735-4985-905b-489b2e4c5d48)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:56:47.506609 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-e3c798c7-cc1f-4677-8785-b79ce235cad3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:47.512743 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cabdd1d-8438-4a76-a39b-9f685b7f8d31 req-90446507-2007-4d4c-9a14-7ce5a336b766 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:47.514276 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1cabdd1d-8438-4a76-a39b-9f685b7f8d31 req-90446507-2007-4d4c-9a14-7ce5a336b766 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0974038 Dec 20 05:56:47.535078 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da37641e-2ff6-4640-8d7d-f0e1390c6488 req-ea333af8-2386-4506-8269-6854295544dd tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:47.539200 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-da37641e-2ff6-4640-8d7d-f0e1390c6488 req-ea333af8-2386-4506-8269-6854295544dd tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0896170 Dec 20 05:56:47.623369 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-da37641e-2ff6-4640-8d7d-f0e1390c6488 req-6501a973-842f-4961-ae84-9f7a717d7c89 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765505 Dec 20 05:56:47.660330 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1cabdd1d-8438-4a76-a39b-9f685b7f8d31 req-5cafe0c3-0989-43c5-b7ed-83f174d27284 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1391456 Dec 20 05:56:47.681942 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 46952) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:47.732752 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c798c7-cc1f-4677-8785-b79ce235cad3 None None] Pushing event updated for resources: {'Port': ['ID=0fdb5ab3-ae47-4202-a1e2-fe074e8b5730,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:47.787194 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'name': 'tempest-TestMinimumBasicScenario-223794928-router', 'tenant_id': 'e5f5841978a84626b73369bafc92e612', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': 'a343b7af-610a-4366-8d53-65e7d17efd82', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:38Z', 'updated_at': '2021-12-20T05:56:42Z', 'revision_number': 4, 'project_id': 'e5f5841978a84626b73369bafc92e612', 'gw_port': {'id': 'a343b7af-610a-4366-8d53-65e7d17efd82', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:14:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 496, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:39Z', 'updated_at': '2021-12-20T05:56:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '0fdb5ab3-ae47-4202-a1e2-fe074e8b5730', 'name': '', 'network_id': '8c423773-73ba-4c57-a6d9-3e1edd7a4798', 'tenant_id': 'e5f5841978a84626b73369bafc92e612', 'mac_address': 'fa:16:3e:f8:55:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'device_owner': 'network:router_interface', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': '9b94b8c4-47a7-41ad-a245-a6b6ac0e356c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:42Z', 'updated_at': '2021-12-20T05:56:46Z', 'revision_number': 4, 'project_id': 'e5f5841978a84626b73369bafc92e612', 'subnets': [{'id': '9b94b8c4-47a7-41ad-a245-a6b6ac0e356c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:47.828695 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6fb1714-de70-4eda-8c80-c1399384c3e4 None None] The sync data for ids ['b6b6dd20-1b3b-4679-8eac-12000f450db9'] in dv-cinder-822278-1-iscsi is: [{'id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'name': 'tempest-TestMinimumBasicScenario-223794928-router', 'tenant_id': 'e5f5841978a84626b73369bafc92e612', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': 'a343b7af-610a-4366-8d53-65e7d17efd82', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:38Z', 'updated_at': '2021-12-20T05:56:42Z', 'revision_number': 4, 'project_id': 'e5f5841978a84626b73369bafc92e612', 'gw_port': {'id': 'a343b7af-610a-4366-8d53-65e7d17efd82', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:14:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 496, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:39Z', 'updated_at': '2021-12-20T05:56:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '0fdb5ab3-ae47-4202-a1e2-fe074e8b5730', 'name': '', 'network_id': '8c423773-73ba-4c57-a6d9-3e1edd7a4798', 'tenant_id': 'e5f5841978a84626b73369bafc92e612', 'mac_address': 'fa:16:3e:f8:55:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'device_owner': 'network:router_interface', 'standard_attr_id': 497, 'fixed_ips': [{'subnet_id': '9b94b8c4-47a7-41ad-a245-a6b6ac0e356c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:42Z', 'updated_at': '2021-12-20T05:56:46Z', 'revision_number': 4, 'project_id': 'e5f5841978a84626b73369bafc92e612', 'subnets': [{'id': '9b94b8c4-47a7-41ad-a245-a6b6ac0e356c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:56:47.835738 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-34bf7961-d552-4766-a024-db37641f1a66 None None] Provisioning complete for port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:47.836115 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-34bf7961-d552-4766-a024-db37641f1a66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:47.860852 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7692bc8c-8f9a-4aef-a842-aab25e0b96fa req-eab29e05-d45d-47e7-85e6-75db977bf7ca tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:47.862460 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7692bc8c-8f9a-4aef-a842-aab25e0b96fa req-eab29e05-d45d-47e7-85e6-75db977bf7ca tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.1189322 Dec 20 05:56:47.990461 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7692bc8c-8f9a-4aef-a842-aab25e0b96fa req-4e5ba0a7-9754-4f04-bac8-3a57f8c3d090 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1115010 Dec 20 05:56:48.049023 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1738ae85-806d-49b9-b52e-63d0981753e8 tempest-TestShelveInstance-1776688185 tempest-TestShelveInstance-1776688185-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:48.053310 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-1738ae85-806d-49b9-b52e-63d0981753e8 tempest-TestShelveInstance-1776688185 tempest-TestShelveInstance-1776688185-project-admin] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 1093 time: 0.3692758 Dec 20 05:56:48.056229 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 46960) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:56:48.060686 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Request body: {'floatingip': {'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'port_id': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'fixed_ip_address': '172.20.0.6'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:48.095226 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for floatingip, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:48.269928 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:48.452934 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Allocated IP 172.27.3.178 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/8f866994-2457-4068-82c3-05405dbc8a2a) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:56:48.613235 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:48.660707 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:48.708236 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:56:48.711102 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:48.716269 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:56:48.719553 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Pushing event updated for resources: {'Port': ['ID=8f866994-2457-4068-82c3-05405dbc8a2a,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:48.751662 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:56:48.751662 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:56:48.752255 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:56:48.752255 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:56:48.752607 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:56:48.752940 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:56:48.753264 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:56:48.753584 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:56:48.753904 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:56:48.754226 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:56:48.754540 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:56:48.754858 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:56:48.755171 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:56:49.194210 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5550002b-3fc8-436c-9d12-1c89e90ea9f9 req-e9524a29-8ac2-4359-b9c0-2a4eb59113fa tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:49.195968 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5550002b-3fc8-436c-9d12-1c89e90ea9f9 req-e9524a29-8ac2-4359-b9c0-2a4eb59113fa tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.1108181 Dec 20 05:56:49.238161 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:49.299643 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5550002b-3fc8-436c-9d12-1c89e90ea9f9 req-fcc54037-77e3-4a3c-aa28-001d37e65896 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0903749 Dec 20 05:56:49.363593 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:49.561269 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:49.567993 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:49.651571 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Pushing event updated for resources: {'Port': ['ID=8f866994-2457-4068-82c3-05405dbc8a2a,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:49.658823 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:49.972270 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:56:49.988003 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.l3_db [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Floating IP b8501923-1f23-40be-b7c2-664717a9978e associated. External IP: 172.27.3.178, port: 8a9f4386-7528-40a4-9b44-826be10f5c21. Dec 20 05:56:50.026286 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:50.026976 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:50.217943 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Router 728e739d-afec-42c9-b7f9-65837b18602c has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:56:50.338856 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:56:50.349893 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bb4023c-8bf5-48e3-bd43-ac9dc78ad87b None None] Sync routers for ids ['728e739d-afec-42c9-b7f9-65837b18602c'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:56:50.361929 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bb4023c-8bf5-48e3-bd43-ac9dc78ad87b None None] Routers {'728e739d-afec-42c9-b7f9-65837b18602c'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:56:50.362789 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-4bb4023c-8bf5-48e3-bd43-ac9dc78ad87b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:56:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['728e739d-afec-42c9-b7f9-65837b18602c'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:50.366880 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:50.415552 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-dfe7b3cc-7cea-4265-b853-8b7638b4eb95 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.3453071 Dec 20 05:56:50.415552 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'tag': '8a9f4386-7528-40a4-9b44-826be10f5c21'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:56:50.415552 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-073d2015-8679-48b8-8bb9-033f64713439" -d '{"events": [{"name": "network-changed", "server_uuid": "7f092569-f7b1-4e5d-859b-95ab2173d63f", "tag": "8a9f4386-7528-40a4-9b44-826be10f5c21"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:56:50.478036 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:56:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a7a34fe5-6717-4f99-a2ba-d81e8b616f04 x-openstack-request-id: req-a7a34fe5-6717-4f99-a2ba-d81e8b616f04 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:56:50.480760 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7f092569-f7b1-4e5d-859b-95ab2173d63f", "tag": "8a9f4386-7528-40a4-9b44-826be10f5c21", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:56:50.481504 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-a7a34fe5-6717-4f99-a2ba-d81e8b616f04 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:56:50.482694 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'tag': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'status': 'completed', 'code': 200} Dec 20 05:56:50.532381 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-4bb4023c-8bf5-48e3-bd43-ac9dc78ad87b None None] Set router 728e739d-afec-42c9-b7f9-65837b18602c gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:56:50.536037 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a67cd71c-fce5-4b66-8e7b-5872f9f5f023 req-bedce681-c67b-487f-8644-c90c7556920d tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:50.537761 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a67cd71c-fce5-4b66-8e7b-5872f9f5f023 req-bedce681-c67b-487f-8644-c90c7556920d tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0789554 Dec 20 05:56:50.622817 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a67cd71c-fce5-4b66-8e7b-5872f9f5f023 req-d85a40d6-197f-4a17-8622-6d259a165c12 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0788944 Dec 20 05:56:50.624543 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-073d2015-8679-48b8-8bb9-033f64713439 req-c094a131-d47a-4394-a8f7-86a938d0730d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:50.625948 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-073d2015-8679-48b8-8bb9-033f64713439 req-c094a131-d47a-4394-a8f7-86a938d0730d service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a67a7ba727e54b1c9f6ca2d5ea21f272&device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 1098 time: 0.0753646 Dec 20 05:56:50.752169 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-073d2015-8679-48b8-8bb9-033f64713439 req-cae5bf4e-3359-4c92-a9a5-b5ce3385788d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:50.754647 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-073d2015-8679-48b8-8bb9-033f64713439 req-cae5bf4e-3359-4c92-a9a5-b5ce3385788d service neutron] 10.222.0.54 "GET /v2.0/networks?id=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 HTTP/1.1" status: 200 len: 910 time: 0.1166646 Dec 20 05:56:50.790324 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-4bb4023c-8bf5-48e3-bd43-ac9dc78ad87b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28'}], 'enable_snat': True}, 'gw_port_id': '973d22fc-4c72-4242-98d2-520773fe8892', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:53Z', 'revision_number': 4, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port': {'id': '973d22fc-4c72-4242-98d2-520773fe8892', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:1e:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': 'b8501923-1f23-40be-b7c2-664717a9978e', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'floating_ip_address': '172.27.3.178', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'port_id': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 499, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'mac_address': 'fa:16:3e:ec:ca:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:56:48Z', 'updated_at': '2021-12-20T05:56:48Z', 'revision_number': 0, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '43066bfd-26eb-4a35-9f53-02e9ff2e6c84', 'name': '', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'mac_address': 'fa:16:3e:6c:72:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:53Z', 'updated_at': '2021-12-20T05:55:58Z', 'revision_number': 5, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'subnets': [{'id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:50.821404 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bb4023c-8bf5-48e3-bd43-ac9dc78ad87b None None] Checking router: 728e739d-afec-42c9-b7f9-65837b18602c for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:56:50.832622 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bb4023c-8bf5-48e3-bd43-ac9dc78ad87b None None] Routers {'728e739d-afec-42c9-b7f9-65837b18602c'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:56:50.836034 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-4bb4023c-8bf5-48e3-bd43-ac9dc78ad87b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:56:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['728e739d-afec-42c9-b7f9-65837b18602c'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:50.838082 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-073d2015-8679-48b8-8bb9-033f64713439 req-a7cbe4e2-9f09-4506-8cd8-110385df715f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=8a9f4386-7528-40a4-9b44-826be10f5c21 HTTP/1.1" status: 200 len: 999 time: 0.0743828 Dec 20 05:56:50.902149 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-073d2015-8679-48b8-8bb9-033f64713439 req-0c37574f-0f60-4ee3-8cd8-dfae46ad5a42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:50.909483 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-073d2015-8679-48b8-8bb9-033f64713439 req-0c37574f-0f60-4ee3-8cd8-dfae46ad5a42 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2b892f1-223d-4384-8544-8bbbbe5c621b HTTP/1.1" status: 200 len: 848 time: 0.0598471 Dec 20 05:56:50.967706 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-4bb4023c-8bf5-48e3-bd43-ac9dc78ad87b None None] Set router 728e739d-afec-42c9-b7f9-65837b18602c gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:56:50.970719 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-073d2015-8679-48b8-8bb9-033f64713439 req-8d835f5d-4521-4e3f-9f58-e7208df2a69e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:50.972237 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-073d2015-8679-48b8-8bb9-033f64713439 req-8d835f5d-4521-4e3f-9f58-e7208df2a69e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0500982 Dec 20 05:56:51.090772 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-073d2015-8679-48b8-8bb9-033f64713439 req-1252e1bb-08c2-46d5-96de-7360da49bf2d service neutron] 10.222.0.54 "GET /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1075027 Dec 20 05:56:51.205844 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-073d2015-8679-48b8-8bb9-033f64713439 req-152a1120-b9e9-43ff-b480-f58ad04b27fa service neutron] 10.222.0.54 "GET /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1063502 Dec 20 05:56:51.248355 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-4bb4023c-8bf5-48e3-bd43-ac9dc78ad87b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28'}], 'enable_snat': True}, 'gw_port_id': '973d22fc-4c72-4242-98d2-520773fe8892', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:53Z', 'revision_number': 4, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port': {'id': '973d22fc-4c72-4242-98d2-520773fe8892', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:1e:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': 'b8501923-1f23-40be-b7c2-664717a9978e', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'floating_ip_address': '172.27.3.178', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'port_id': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 499, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'mac_address': 'fa:16:3e:ec:ca:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:56:48Z', 'updated_at': '2021-12-20T05:56:48Z', 'revision_number': 0, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '43066bfd-26eb-4a35-9f53-02e9ff2e6c84', 'name': '', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'mac_address': 'fa:16:3e:6c:72:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:53Z', 'updated_at': '2021-12-20T05:55:58Z', 'revision_number': 5, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'subnets': [{'id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:56:51.279556 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bb4023c-8bf5-48e3-bd43-ac9dc78ad87b None None] The sync data for ids ['728e739d-afec-42c9-b7f9-65837b18602c'] in dv-cinder-822278-1-iscsi is: [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28'}], 'enable_snat': True}, 'gw_port_id': '973d22fc-4c72-4242-98d2-520773fe8892', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:53Z', 'revision_number': 4, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port': {'id': '973d22fc-4c72-4242-98d2-520773fe8892', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:1e:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': 'b8501923-1f23-40be-b7c2-664717a9978e', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'floating_ip_address': '172.27.3.178', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'port_id': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 499, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'mac_address': 'fa:16:3e:ec:ca:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:56:48Z', 'updated_at': '2021-12-20T05:56:48Z', 'revision_number': 0, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '43066bfd-26eb-4a35-9f53-02e9ff2e6c84', 'name': '', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'mac_address': 'fa:16:3e:6c:72:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:53Z', 'updated_at': '2021-12-20T05:55:58Z', 'revision_number': 5, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'subnets': [{'id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:56:51.507147 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4f94a94-ed8b-4c99-8be2-b2000b5f7cc5 None None] New status for floating IP b8501923-1f23-40be-b7c2-664717a9978e: ACTIVE {{(pid=102447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 05:56:51.781441 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c397af49-d16a-48dc-9873-2a93aa7ea0c1 req-d6faae11-4d2d-4276-922b-9d74da14424d tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:51.783156 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c397af49-d16a-48dc-9873-2a93aa7ea0c1 req-d6faae11-4d2d-4276-922b-9d74da14424d tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0601449 Dec 20 05:56:51.835358 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c397af49-d16a-48dc-9873-2a93aa7ea0c1 req-2f1e881c-a67f-4826-bf94-425ba2b981fe tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458345 Dec 20 05:56:52.968086 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3a4b71-074e-40d0-8a1f-a3b3e44d7326 req-47600f5e-5c99-4382-844f-3555084f1589 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:52.969807 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4f3a4b71-074e-40d0-8a1f-a3b3e44d7326 req-47600f5e-5c99-4382-844f-3555084f1589 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0523262 Dec 20 05:56:53.029542 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4f3a4b71-074e-40d0-8a1f-a3b3e44d7326 req-fffc3f8b-e1b9-418b-8198-1c070d830f4a tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0535145 Dec 20 05:56:54.185935 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a394ea2-131e-4f4d-87a7-613acb0712bd req-cfefb4a0-7550-4d5c-93d9-3b0c56d1acde tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:54.188412 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3a394ea2-131e-4f4d-87a7-613acb0712bd req-cfefb4a0-7550-4d5c-93d9-3b0c56d1acde tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0564387 Dec 20 05:56:54.245049 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3a394ea2-131e-4f4d-87a7-613acb0712bd req-86db05a1-b007-4623-875d-f4136b386376 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477269 Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.293262 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.296504 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.296504 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.296504 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.296504 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.296504 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.296504 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.296504 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.296504 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.296504 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.296504 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.296504 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:56:55.296504 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:56:55.296504 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-685b39c9-c8c5-4149-8106-b67851e67d46 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:55.296504 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-685b39c9-c8c5-4149-8106-b67851e67d46 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/networks?id=4e35b188-ad5c-4cae-9209-b7e538e3669f HTTP/1.1" status: 200 len: 815 time: 0.1168489 Dec 20 05:56:55.313978 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-ea8086da-3b71-41c5-970e-006074542779 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/quotas/627c52664e194163a380283ded298eb5 HTTP/1.1" status: 200 len: 375 time: 0.0101449 Dec 20 05:56:55.396582 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26b2b4aa-df1e-4a7f-b382-0dff5b6771a8 req-c50a4ce7-36aa-416f-b607-d3a7a987d693 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:55.397547 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-26b2b4aa-df1e-4a7f-b382-0dff5b6771a8 req-c50a4ce7-36aa-416f-b607-d3a7a987d693 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0787890 Dec 20 05:56:55.403361 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-d23b685b-ae4f-45dc-9660-8316e1561848 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=627c52664e194163a380283ded298eb5&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0752344 Dec 20 05:56:55.496243 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-26b2b4aa-df1e-4a7f-b382-0dff5b6771a8 req-8c7a03e5-3d64-4b69-afa9-7982efe206a8 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0919113 Dec 20 05:56:55.523327 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-12a7f694-bb02-4ba5-b1c7-3a00cbbaef19 service neutron] 10.222.0.46 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1064050 Dec 20 05:56:55.610330 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-5cee44f3-6f33-4613-8248-e566c702e1d0 service neutron] 10.222.0.46 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809107 Dec 20 05:56:55.771049 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9d8fcf14-d426-47f1-a581-6718a3934fb7 req-e07b1e25-f3e9-4012-8037-8af7aedf0e4b tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 210 time: 0.0313864 Dec 20 05:56:56.621833 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a93b20da-ac72-41f3-b15c-cf64d5c93136 req-e351fdeb-7b17-4ca9-865a-19fd140d4cbe tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:56.623356 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a93b20da-ac72-41f3-b15c-cf64d5c93136 req-e351fdeb-7b17-4ca9-865a-19fd140d4cbe tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0533414 Dec 20 05:56:56.671022 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a93b20da-ac72-41f3-b15c-cf64d5c93136 req-3f297d2d-c49a-4baf-aa64-d9562062700e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412860 Dec 20 05:56:56.886383 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3431a3fa-5e61-483a-9e44-73358610fd15 req-70e0a662-fe95-4afa-b181-7a8d82a28e70 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 210 time: 0.0462871 Dec 20 05:56:57.213634 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04314fcb-6db7-49f2-94b1-201fb0ff556c req-05005588-6846-45c1-9c91-e539f1eb8762 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:57.220420 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-04314fcb-6db7-49f2-94b1-201fb0ff556c req-05005588-6846-45c1-9c91-e539f1eb8762 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0568144 Dec 20 05:56:57.284505 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-04314fcb-6db7-49f2-94b1-201fb0ff556c req-c4e137ef-2f5a-4976-a314-a9c4b5167f3e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628884 Dec 20 05:56:57.307619 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be9606d-3996-423e-9d4d-c63e578ffc8c req-2714d930-2e8e-4fcb-8d7a-0ede5a18e913 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:57.309750 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4be9606d-3996-423e-9d4d-c63e578ffc8c req-2714d930-2e8e-4fcb-8d7a-0ede5a18e913 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a2e9de0d64e642f08bf90d402e77baa3&device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 1098 time: 0.0499861 Dec 20 05:56:57.366734 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-8b01aa22-4cb0-4d07-b0c8-63437c93dd3b tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:57.368718 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-8b01aa22-4cb0-4d07-b0c8-63437c93dd3b tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.54 "GET /v2.0/networks?id=4e35b188-ad5c-4cae-9209-b7e538e3669f HTTP/1.1" status: 200 len: 815 time: 0.1089661 Dec 20 05:56:57.396776 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-231c3e4d-c377-4a60-8e89-75af8e82874a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Request body: {'port': {'device_id': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'admin_state_up': True, 'tenant_id': '627c52664e194163a380283ded298eb5'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:56:57.409508 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be9606d-3996-423e-9d4d-c63e578ffc8c req-64c1794c-dd60-498a-a73f-68f3bf18cf90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:57.410993 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4be9606d-3996-423e-9d4d-c63e578ffc8c req-64c1794c-dd60-498a-a73f-68f3bf18cf90 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a HTTP/1.1" status: 200 len: 920 time: 0.0901423 Dec 20 05:56:57.466514 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4be9606d-3996-423e-9d4d-c63e578ffc8c req-3168f9c2-622d-49f0-8e14-215d2acf0442 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 HTTP/1.1" status: 200 len: 217 time: 0.0397503 Dec 20 05:56:57.510331 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-231c3e4d-c377-4a60-8e89-75af8e82874a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Made reservation on behalf of 627c52664e194163a380283ded298eb5 for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:56:57.513822 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-231c3e4d-c377-4a60-8e89-75af8e82874a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:57.517572 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be9606d-3996-423e-9d4d-c63e578ffc8c req-c12cf6cb-056c-44bf-a12d-79a3228eb6c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:57.519038 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4be9606d-3996-423e-9d4d-c63e578ffc8c req-c12cf6cb-056c-44bf-a12d-79a3228eb6c4 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=e1658c3d-4c2e-4687-a529-637456d3a81c HTTP/1.1" status: 200 len: 859 time: 0.0432374 Dec 20 05:56:57.549683 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4be9606d-3996-423e-9d4d-c63e578ffc8c req-f4add7f4-710e-450e-833c-f2ed8d8b9725 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0231321 Dec 20 05:56:57.643542 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-231c3e4d-c377-4a60-8e89-75af8e82874a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Allocated IP 172.20.0.8 (4e35b188-ad5c-4cae-9209-b7e538e3669f/fca5c9c5-06df-4c64-840c-e8558a30dd3c/18320379-21ed-4b2e-af2c-62b95cf39325) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:56:57.664326 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4be9606d-3996-423e-9d4d-c63e578ffc8c req-08a33b22-420e-4d7a-af09-387f115d1e29 service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0953715 Dec 20 05:56:57.775279 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4be9606d-3996-423e-9d4d-c63e578ffc8c req-2bcb38ae-06b6-4bde-ac7d-966dba70eac6 service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1001635 Dec 20 05:56:57.857192 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7233a936-221e-4f0c-89bf-6df0baf7e33d req-16e92ee3-5eea-4a7d-bef4-b415e2a33e22 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:57.859070 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7233a936-221e-4f0c-89bf-6df0baf7e33d req-16e92ee3-5eea-4a7d-bef4-b415e2a33e22 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0941114 Dec 20 05:56:57.862780 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-231c3e4d-c377-4a60-8e89-75af8e82874a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:57.937757 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7233a936-221e-4f0c-89bf-6df0baf7e33d req-28ae0f47-0549-4395-8a99-d540951f418f tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0711114 Dec 20 05:56:57.971464 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-231c3e4d-c377-4a60-8e89-75af8e82874a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:58.074658 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-231c3e4d-c377-4a60-8e89-75af8e82874a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Network 4e35b188-ad5c-4cae-9209-b7e538e3669f is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:56:58.088165 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-231c3e4d-c377-4a60-8e89-75af8e82874a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:56:58.096364 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-231c3e4d-c377-4a60-8e89-75af8e82874a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:56:58.149187 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3f57c7-3f2c-4102-9410-523992020474 req-527f8a85-815b-4bf5-9fc9-bd0478f59f95 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:58.150976 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-de3f57c7-3f2c-4102-9410-523992020474 req-527f8a85-815b-4bf5-9fc9-bd0478f59f95 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 931 time: 0.1771877 Dec 20 05:56:58.156229 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-231c3e4d-c377-4a60-8e89-75af8e82874a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event updated for resources: {'Port': ['ID=18320379-21ed-4b2e-af2c-62b95cf39325,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:56:58.200257 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-231c3e4d-c377-4a60-8e89-75af8e82874a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:58.202743 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-231c3e4d-c377-4a60-8e89-75af8e82874a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:58.253934 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-de3f57c7-3f2c-4102-9410-523992020474 req-bdc3e21f-7ee2-4485-926a-e449668ce425 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0915523 Dec 20 05:56:58.307091 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-231c3e4d-c377-4a60-8e89-75af8e82874a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9145861 Dec 20 05:56:58.376323 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59f59098-c04f-4ef9-b7e2-36767521bba9 req-85a646d0-d97b-49a1-96ce-d26c5ad94192 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:58.388218 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-59f59098-c04f-4ef9-b7e2-36767521bba9 req-85a646d0-d97b-49a1-96ce-d26c5ad94192 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.1082544 Dec 20 05:56:58.456241 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-76d78eee-f209-4cc3-8941-35e515ea68ab None None] Provisioning complete for port 18320379-21ed-4b2e-af2c-62b95cf39325 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:56:58.457447 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-76d78eee-f209-4cc3-8941-35e515ea68ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:56:58.492176 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-59f59098-c04f-4ef9-b7e2-36767521bba9 req-8e646297-679f-43ea-8972-54aa770fa68d tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0975261 Dec 20 05:56:58.507902 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bdeadf6-702a-4675-8bc6-2c2fe028bf32 req-618a00e8-92d7-4745-8334-01f9635986e7 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:58.509779 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9bdeadf6-702a-4675-8bc6-2c2fe028bf32 req-618a00e8-92d7-4745-8334-01f9635986e7 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0995870 Dec 20 05:56:58.511262 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-76d78eee-f209-4cc3-8941-35e515ea68ab None None] Port 18320379-21ed-4b2e-af2c-62b95cf39325 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:56:58.581514 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9bdeadf6-702a-4675-8bc6-2c2fe028bf32 req-14e70eb4-7389-482f-8641-03295fef952c tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0565178 Dec 20 05:56:59.393471 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b036e1c2-02f4-4104-8ffa-0ba1f555d7d9 req-ed0e82a0-fa55-4996-9b41-efca5a76f369 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:59.395108 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b036e1c2-02f4-4104-8ffa-0ba1f555d7d9 req-ed0e82a0-fa55-4996-9b41-efca5a76f369 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 931 time: 0.0549238 Dec 20 05:56:59.450381 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b036e1c2-02f4-4104-8ffa-0ba1f555d7d9 req-fa534db2-cd39-4716-9767-ae2fbb4fe00d tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471833 Dec 20 05:56:59.605676 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-940adc3b-62e5-4a1e-aeb6-2cdd339a6567 req-c907cd78-9045-4dfa-a727-6877daed9ea8 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:59.608439 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-940adc3b-62e5-4a1e-aeb6-2cdd339a6567 req-c907cd78-9045-4dfa-a727-6877daed9ea8 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0502760 Dec 20 05:56:59.662410 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-940adc3b-62e5-4a1e-aeb6-2cdd339a6567 req-bc597810-8e3d-4284-b2fb-7d6587d410b7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470953 Dec 20 05:56:59.715386 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-033a0d0f-f1c0-44fe-b041-148615ba466b req-f5c78404-50df-4784-8358-8df823238862 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:56:59.717081 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-033a0d0f-f1c0-44fe-b041-148615ba466b req-f5c78404-50df-4784-8358-8df823238862 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0538762 Dec 20 05:56:59.763964 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-033a0d0f-f1c0-44fe-b041-148615ba466b req-03177fd7-9446-4f8b-a18e-73d7161dda1a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408359 Dec 20 05:56:59.969163 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:57:00.577074 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ee4ef1b-f37c-4e26-a9cc-69ac3487b2df req-c85709a3-d8f0-40b9-b531-4fe20bab5240 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:00.578567 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0ee4ef1b-f37c-4e26-a9cc-69ac3487b2df req-c85709a3-d8f0-40b9-b531-4fe20bab5240 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 931 time: 0.0495400 Dec 20 05:57:00.628380 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0ee4ef1b-f37c-4e26-a9cc-69ac3487b2df req-ce27a205-8b37-462c-b10d-881500b73d00 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436814 Dec 20 05:57:00.777719 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29433d5a-4066-4313-a856-8d4d0c02d293 req-796f0729-10c7-421d-95b7-b3697ba122c1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:00.779462 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-29433d5a-4066-4313-a856-8d4d0c02d293 req-796f0729-10c7-421d-95b7-b3697ba122c1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0486660 Dec 20 05:57:00.837658 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-29433d5a-4066-4313-a856-8d4d0c02d293 req-755a59a6-bc26-4e07-bd1e-c52089a0b9c7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0518599 Dec 20 05:57:00.887088 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01c97fef-ce9e-4c28-811b-d2d129ec89bd req-cc830623-20d0-4bce-9b0b-8024fb1a3eb5 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:00.888812 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-01c97fef-ce9e-4c28-811b-d2d129ec89bd req-cc830623-20d0-4bce-9b0b-8024fb1a3eb5 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0502975 Dec 20 05:57:00.935775 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-01c97fef-ce9e-4c28-811b-d2d129ec89bd req-851cde38-d12c-4164-95d3-82f439e09a4e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404518 Dec 20 05:57:01.712652 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-143da4e7-14b6-477d-9f47-19554062fda2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:01.745936 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5a6b3c3-27ab-4c87-8e80-81fc3c81593b req-079249de-4806-4b82-bd4b-0199936ebceb tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:01.747417 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b5a6b3c3-27ab-4c87-8e80-81fc3c81593b req-079249de-4806-4b82-bd4b-0199936ebceb tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 931 time: 0.0527644 Dec 20 05:57:01.794907 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b5a6b3c3-27ab-4c87-8e80-81fc3c81593b req-899347c4-5b74-4735-9055-acb8d0bfa8df tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415134 Dec 20 05:57:01.965861 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71bd4159-5204-4498-b71b-b2a1dd3dadc1 req-74d98d75-8121-4eb8-9e30-e76417e85858 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:01.967581 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-71bd4159-5204-4498-b71b-b2a1dd3dadc1 req-74d98d75-8121-4eb8-9e30-e76417e85858 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0604019 Dec 20 05:57:02.026206 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-71bd4159-5204-4498-b71b-b2a1dd3dadc1 req-d62e7190-98ab-4f28-95dc-38bc266b1576 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0522087 Dec 20 05:57:02.061575 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e3f4664-59d0-4be8-b906-54375702fc1b req-7f9413c5-4598-479b-a878-787b545c333f tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:02.063283 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5e3f4664-59d0-4be8-b906-54375702fc1b req-7f9413c5-4598-479b-a878-787b545c333f tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0537364 Dec 20 05:57:02.111405 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5e3f4664-59d0-4be8-b906-54375702fc1b req-e9434256-c09f-42d1-a753-c69543dae406 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422494 Dec 20 05:57:02.924596 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b7108d9-58e1-47fe-9b08-63d83ab9537b req-47a9fa90-2e6e-4eca-add9-2c194ea68748 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:02.926981 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6b7108d9-58e1-47fe-9b08-63d83ab9537b req-47a9fa90-2e6e-4eca-add9-2c194ea68748 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 931 time: 0.0503945 Dec 20 05:57:02.977244 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6b7108d9-58e1-47fe-9b08-63d83ab9537b req-31d58948-108e-4cf0-81e8-87f1ffb39235 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434921 Dec 20 05:57:03.145266 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3fcb12f-dc58-48f4-8506-8eb48e7a887a req-5d91a6c3-4a28-4123-a296-49e61ec40006 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:03.146984 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e3fcb12f-dc58-48f4-8506-8eb48e7a887a req-5d91a6c3-4a28-4123-a296-49e61ec40006 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0518250 Dec 20 05:57:03.223422 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e3fcb12f-dc58-48f4-8506-8eb48e7a887a req-b0748371-373b-4700-bc2a-0c5ce441d220 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0694609 Dec 20 05:57:03.242349 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-825e30d4-d22c-4050-963b-be9abc916dc9 req-d4a872a4-bf7c-40ea-b88a-825c7a1bbd85 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:03.243760 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-825e30d4-d22c-4050-963b-be9abc916dc9 req-d4a872a4-bf7c-40ea-b88a-825c7a1bbd85 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0598419 Dec 20 05:57:03.294003 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-825e30d4-d22c-4050-963b-be9abc916dc9 req-162953bb-0a11-45dd-bc6c-99d2fea78029 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440230 Dec 20 05:57:04.098312 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-215a4c56-23b2-4189-883e-1a8c88b04ad5 req-61b257d7-0629-40b9-bb00-3df4b2d6f363 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:04.099855 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-215a4c56-23b2-4189-883e-1a8c88b04ad5 req-61b257d7-0629-40b9-bb00-3df4b2d6f363 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 931 time: 0.0564594 Dec 20 05:57:04.147641 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-b8217b41-ecbb-48bf-becf-ed4bae41f716 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:04.149991 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-215a4c56-23b2-4189-883e-1a8c88b04ad5 req-56ad4926-16ca-4ece-bb22-de0390d89f3d tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436590 Dec 20 05:57:04.342108 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36e9953e-c336-40bf-9777-ba0c0778f30b req-6e955477-c85a-4046-99d2-675c1bdec679 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:04.343699 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-36e9953e-c336-40bf-9777-ba0c0778f30b req-6e955477-c85a-4046-99d2-675c1bdec679 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0518177 Dec 20 05:57:04.419365 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-36e9953e-c336-40bf-9777-ba0c0778f30b req-b8da2a29-b1bf-4066-a2d3-75018926d8da tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0695527 Dec 20 05:57:04.432853 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-774b8e5f-bc2d-4451-a2f9-188b74fd70f2 req-8069e2a8-ffbe-4173-9e98-941fb7f4741c tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:04.434295 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-774b8e5f-bc2d-4451-a2f9-188b74fd70f2 req-8069e2a8-ffbe-4173-9e98-941fb7f4741c tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0693483 Dec 20 05:57:04.483668 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-774b8e5f-bc2d-4451-a2f9-188b74fd70f2 req-85ffea4a-db61-4aba-99e5-8b1bbff2c266 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436072 Dec 20 05:57:04.981160 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:05.268730 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2ec133-7e6d-4782-8390-cc6eb2bec4b3 req-36843d4b-0886-4504-bb1d-850824fa68f0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:05.270109 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1d2ec133-7e6d-4782-8390-cc6eb2bec4b3 req-36843d4b-0886-4504-bb1d-850824fa68f0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 931 time: 0.0488198 Dec 20 05:57:05.316161 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1d2ec133-7e6d-4782-8390-cc6eb2bec4b3 req-8caa7295-65d0-4067-a496-28f5484d6dea tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396466 Dec 20 05:57:05.534163 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-713def08-980d-4b04-890a-4dff48116581 req-b8b59be9-5366-4628-87a4-425817d53524 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:05.535684 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-713def08-980d-4b04-890a-4dff48116581 req-b8b59be9-5366-4628-87a4-425817d53524 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0485458 Dec 20 05:57:05.618374 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-713def08-980d-4b04-890a-4dff48116581 req-af5a3d35-1df8-4ac2-bbde-3bd3f616570f tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0763595 Dec 20 05:57:05.629982 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c4bf32f-7f20-4e46-ac1e-4d929659d2ab req-12b81f27-331e-4abe-873d-8c5e39c1be86 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:05.631427 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3c4bf32f-7f20-4e46-ac1e-4d929659d2ab req-12b81f27-331e-4abe-873d-8c5e39c1be86 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0743976 Dec 20 05:57:05.681352 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3c4bf32f-7f20-4e46-ac1e-4d929659d2ab req-5e50544a-c97f-4157-8a83-dbd28f3423cb tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441225 Dec 20 05:57:06.429166 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e19a169b-4b80-4fa8-8613-2d9cbcc2f215 req-5ab765e5-bce8-4459-9eaa-cf1ca3aa7e5d tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:06.430694 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e19a169b-4b80-4fa8-8613-2d9cbcc2f215 req-5ab765e5-bce8-4459-9eaa-cf1ca3aa7e5d tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 931 time: 0.0488615 Dec 20 05:57:06.469182 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:06.478889 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e19a169b-4b80-4fa8-8613-2d9cbcc2f215 req-d99ad4ab-e707-4069-8be9-d7d094b9a9bc tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420938 Dec 20 05:57:06.737220 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-142cd01c-4e4e-463e-be95-97418e0d3214 req-671d5a18-a8b5-4e44-9b7c-a4a706473204 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:06.739124 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-142cd01c-4e4e-463e-be95-97418e0d3214 req-671d5a18-a8b5-4e44-9b7c-a4a706473204 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0539782 Dec 20 05:57:06.826111 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-142cd01c-4e4e-463e-be95-97418e0d3214 req-6b0edfea-7963-49d3-93e6-7a3cbe7d7510 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0802565 Dec 20 05:57:06.837327 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c8857a2-a56b-44f6-b003-c64e3f10774b req-dd1c0458-a4dd-4178-8c46-b033cdd0e2a0 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:06.838864 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7c8857a2-a56b-44f6-b003-c64e3f10774b req-dd1c0458-a4dd-4178-8c46-b033cdd0e2a0 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0862160 Dec 20 05:57:06.888228 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7c8857a2-a56b-44f6-b003-c64e3f10774b req-23e537b6-81e7-4f6a-8ac6-64bb113e06bc tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435462 Dec 20 05:57:07.344578 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:07.570896 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:07.615084 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fa825d6-a360-440c-8d32-0fd578845d54 req-0d196a07-afc0-4348-b235-fb05a609dab9 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:07.616758 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6fa825d6-a360-440c-8d32-0fd578845d54 req-0d196a07-afc0-4348-b235-fb05a609dab9 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 931 time: 0.0644126 Dec 20 05:57:07.680195 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6fa825d6-a360-440c-8d32-0fd578845d54 req-9718567b-1f58-4b91-bc89-5f75a0aadfa1 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559304 Dec 20 05:57:07.956243 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c28213c5-1ad0-4981-8b47-ac768ca246c9 req-bf298641-c286-439b-b42d-b4abf8bec05c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:07.958041 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c28213c5-1ad0-4981-8b47-ac768ca246c9 req-bf298641-c286-439b-b42d-b4abf8bec05c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0583537 Dec 20 05:57:08.036334 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c28213c5-1ad0-4981-8b47-ac768ca246c9 req-851fc1a4-c962-4f89-a705-a2a924f41fd1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0719411 Dec 20 05:57:08.044433 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38406943-4afd-441e-8e0a-5d2e80e73583 req-da35fd78-e421-4806-9036-9eea39b4fe62 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:08.045892 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-38406943-4afd-441e-8e0a-5d2e80e73583 req-da35fd78-e421-4806-9036-9eea39b4fe62 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0803690 Dec 20 05:57:08.096068 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-38406943-4afd-441e-8e0a-5d2e80e73583 req-43983449-1b29-4e0e-9a9d-8035bf5f2c1e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440540 Dec 20 05:57:08.801474 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee003356-78bb-4dba-9ab3-cb471c52bbd3 req-959c5c4c-5b1d-4483-943a-3b156e8c8b93 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:08.802964 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ee003356-78bb-4dba-9ab3-cb471c52bbd3 req-959c5c4c-5b1d-4483-943a-3b156e8c8b93 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 931 time: 0.0534930 Dec 20 05:57:08.852349 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ee003356-78bb-4dba-9ab3-cb471c52bbd3 req-60acf243-b80a-4b1c-b1b8-da7739e1b4bf tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429323 Dec 20 05:57:09.164918 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1dab33-391d-43a2-bbec-690e4866085e req-c5417eba-5bec-408c-b62a-8e4f4dded622 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:09.166429 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2b1dab33-391d-43a2-bbec-690e4866085e req-c5417eba-5bec-408c-b62a-8e4f4dded622 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0525374 Dec 20 05:57:09.255401 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7906f71f-2c31-42d5-879b-d8a69b23e033 req-55dbd2ef-29ee-408b-b0d2-cd8d60162b58 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:09.256978 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7906f71f-2c31-42d5-879b-d8a69b23e033 req-55dbd2ef-29ee-408b-b0d2-cd8d60162b58 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0884414 Dec 20 05:57:09.265538 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2b1dab33-391d-43a2-bbec-690e4866085e req-97da7876-e1ca-4971-a73c-b6db764b9da4 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0877769 Dec 20 05:57:09.311042 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7906f71f-2c31-42d5-879b-d8a69b23e033 req-c7074589-4362-421e-9baa-253537f8e7fe tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443823 Dec 20 05:57:09.975615 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed5326f7-226c-451e-ac7d-5dac26430fe3 req-8108ff21-e4ab-446e-9b61-5e2af8b85974 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:09.977745 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ed5326f7-226c-451e-ac7d-5dac26430fe3 req-8108ff21-e4ab-446e-9b61-5e2af8b85974 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 931 time: 0.0542424 Dec 20 05:57:10.026712 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ed5326f7-226c-451e-ac7d-5dac26430fe3 req-325d972a-4b2c-4486-8782-570baddd3421 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431142 Dec 20 05:57:10.381477 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-526c0b82-b059-47f8-9bd3-e3f19906294c req-8620c643-4055-4f1c-ab40-7a222ede8b68 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:10.383055 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-526c0b82-b059-47f8-9bd3-e3f19906294c req-8620c643-4055-4f1c-ab40-7a222ede8b68 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0496519 Dec 20 05:57:10.462367 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0740932-af25-4f85-baa8-2d1477b7e8ea req-cd2b63a4-0abe-44c7-b0e0-c406d38287ba tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:10.463761 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e0740932-af25-4f85-baa8-2d1477b7e8ea req-cd2b63a4-0abe-44c7-b0e0-c406d38287ba tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0797946 Dec 20 05:57:10.468095 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-526c0b82-b059-47f8-9bd3-e3f19906294c req-4eca9acf-ca52-459b-85f2-2e16b73a2583 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0749288 Dec 20 05:57:10.510070 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e0740932-af25-4f85-baa8-2d1477b7e8ea req-1c11bc50-db7a-4cf7-8a10-0c2ef35a9004 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404007 Dec 20 05:57:10.836449 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Request body: {'port': {'device_id': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:57:10.890033 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:11.054720 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b8deba-cfaa-4798-97fa-2019aafeb294 req-9ce522fb-98ed-4132-98fe-9c5fdc69e797 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:11.056283 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-d8b8deba-cfaa-4798-97fa-2019aafeb294 req-9ce522fb-98ed-4132-98fe-9c5fdc69e797 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1898b7c1b3dc4523b09a97486622c67e&device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 1098 time: 0.0495143 Dec 20 05:57:11.160820 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b8deba-cfaa-4798-97fa-2019aafeb294 req-31db2dc6-1003-4387-ba55-7e6a38551437 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:11.162299 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-d8b8deba-cfaa-4798-97fa-2019aafeb294 req-31db2dc6-1003-4387-ba55-7e6a38551437 service neutron] 10.222.0.54 "GET /v2.0/networks?id=6924a88e-10c1-4073-a41c-88aad14ebd0f HTTP/1.1" status: 200 len: 912 time: 0.0886943 Dec 20 05:57:11.183259 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58cedf51-236e-45f1-be77-eb50fc5aa9e6 req-50c27165-3821-44c8-b545-345bad4f195a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:11.184740 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58cedf51-236e-45f1-be77-eb50fc5aa9e6 req-50c27165-3821-44c8-b545-345bad4f195a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 931 time: 0.0911005 Dec 20 05:57:11.189936 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 18320379-21ed-4b2e-af2c-62b95cf39325 {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:57:11.203098 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:11.225613 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Transition to ACTIVE for port object 18320379-21ed-4b2e-af2c-62b95cf39325 will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 05:57:11.233447 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:11.234284 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-d8b8deba-cfaa-4798-97fa-2019aafeb294 req-dbe3fb8a-1625-4dec-ace2-bff51d376fbc service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=abed4d23-da46-4f59-9f36-c9fc12fcb192 HTTP/1.1" status: 200 len: 1001 time: 0.0588398 Dec 20 05:57:11.288325 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58cedf51-236e-45f1-be77-eb50fc5aa9e6 req-7ad3524a-a476-4f19-a369-c63d50b096fd tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0938334 Dec 20 05:57:11.289765 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b8deba-cfaa-4798-97fa-2019aafeb294 req-fcb0bb98-5ee0-4a2f-bb7c-08e4c8453cd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:11.292029 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-d8b8deba-cfaa-4798-97fa-2019aafeb294 req-fcb0bb98-5ee0-4a2f-bb7c-08e4c8453cd8 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ffb588f9-2ffb-4921-8a76-be5179c2fbed HTTP/1.1" status: 200 len: 850 time: 0.0493994 Dec 20 05:57:11.299715 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Pushing event updated for resources: {'Port': ['ID=18320379-21ed-4b2e-af2c-62b95cf39325,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:11.342595 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b8deba-cfaa-4798-97fa-2019aafeb294 req-80545627-3e58-4af7-8451-b3e2aaed20e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:11.344150 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-d8b8deba-cfaa-4798-97fa-2019aafeb294 req-80545627-3e58-4af7-8451-b3e2aaed20e1 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6924a88e-10c1-4073-a41c-88aad14ebd0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0436041 Dec 20 05:57:11.374658 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Attempting to bind port 18320379-21ed-4b2e-af2c-62b95cf39325 on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:57:11.375141 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Attempting to bind port 18320379-21ed-4b2e-af2c-62b95cf39325 by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': '6a78353a-8122-4f87-a059-aadb4a3c82d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:57:11.375469 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Attempting to bind port 18320379-21ed-4b2e-af2c-62b95cf39325 on network 4e35b188-ad5c-4cae-9209-b7e538e3669f {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:57:11.380211 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Port 18320379-21ed-4b2e-af2c-62b95cf39325 on network 4e35b188-ad5c-4cae-9209-b7e538e3669f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 05:57:11.380661 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Attempting to bind port 18320379-21ed-4b2e-af2c-62b95cf39325 on network 4e35b188-ad5c-4cae-9209-b7e538e3669f {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:57:11.387788 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 57, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:57:11.388263 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Checking segment: {'id': '6a78353a-8122-4f87-a059-aadb4a3c82d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:57:11.388646 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Bound using segment: {'id': '6a78353a-8122-4f87-a059-aadb4a3c82d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:57:11.389074 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Bound port: 18320379-21ed-4b2e-af2c-62b95cf39325, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6a78353a-8122-4f87-a059-aadb4a3c82d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:57:11.390025 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:11.453283 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-d8b8deba-cfaa-4798-97fa-2019aafeb294 req-223a729c-976b-46aa-9d60-ef9697e100a5 service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0990229 Dec 20 05:57:11.478358 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] For port 18320379-21ed-4b2e-af2c-62b95cf39325, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:57:11.481411 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] For port 18320379-21ed-4b2e-af2c-62b95cf39325, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=18320379-21ed-4b2e-af2c-62b95cf39325,segment=NetworkSegment(6a78353a-8122-4f87-a059-aadb4a3c82d5),segment_id=6a78353a-8122-4f87-a059-aadb4a3c82d5)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:57:11.485256 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:11.521627 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:11.522251 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:11.523948 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] 10.222.0.54 "PUT /v2.0/ports/18320379-21ed-4b2e-af2c-62b95cf39325 HTTP/1.1" status: 200 len: 1093 time: 0.6922174 Dec 20 05:57:11.524458 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'tag': '18320379-21ed-4b2e-af2c-62b95cf39325'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:57:11.526592 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a581125-a71a-4bc0-80ae-b0bfd806f76b" -d '{"events": [{"name": "network-changed", "server_uuid": "d315076f-1aa5-4b60-ade2-0210f6406b1d", "tag": "18320379-21ed-4b2e-af2c-62b95cf39325"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:57:11.562161 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f651ac79-f5a3-4265-a467-753cf10810c6 service neutron] Pushing event updated for resources: {'Port': ['ID=18320379-21ed-4b2e-af2c-62b95cf39325,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:11.575844 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:57:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-22e5c3d7-a901-4299-b634-c1339aa3c8aa x-openstack-request-id: req-22e5c3d7-a901-4299-b634-c1339aa3c8aa {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:57:11.576137 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d315076f-1aa5-4b60-ade2-0210f6406b1d", "tag": "18320379-21ed-4b2e-af2c-62b95cf39325", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:57:11.576400 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-22e5c3d7-a901-4299-b634-c1339aa3c8aa {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:57:11.576840 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'tag': '18320379-21ed-4b2e-af2c-62b95cf39325', 'status': 'completed', 'code': 200} Dec 20 05:57:11.583065 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-d8b8deba-cfaa-4798-97fa-2019aafeb294 req-d78e48c0-8eca-4952-ba74-c04bab9f0118 service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1207724 Dec 20 05:57:11.636423 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbd36802-8e28-4bd0-ad80-aecc2938ce47 req-638a1a21-bfb0-4e84-a3b3-1f67028cd2b5 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:11.638376 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bbd36802-8e28-4bd0-ad80-aecc2938ce47 req-638a1a21-bfb0-4e84-a3b3-1f67028cd2b5 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0564961 Dec 20 05:57:11.672083 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-ced7292e-ecf8-4e2e-967b-5d965f7c8ac2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:11.673869 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-ced7292e-ecf8-4e2e-967b-5d965f7c8ac2 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=627c52664e194163a380283ded298eb5&device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 1096 time: 0.0503700 Dec 20 05:57:11.737558 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c40266-121f-4168-9443-2d9ab344eacc req-7e05f201-0879-4c48-8fa8-26f77206758d tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:11.739037 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e7c40266-121f-4168-9443-2d9ab344eacc req-7e05f201-0879-4c48-8fa8-26f77206758d tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0846939 Dec 20 05:57:11.742535 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bbd36802-8e28-4bd0-ad80-aecc2938ce47 req-681abf02-1fc4-4a36-b886-61f9a6bd9086 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0791776 Dec 20 05:57:11.750267 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-2cfb8dcb-f393-45f7-9300-729c39d45b04 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=18320379-21ed-4b2e-af2c-62b95cf39325 HTTP/1.1" status: 200 len: 217 time: 0.0404816 Dec 20 05:57:11.793517 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e7c40266-121f-4168-9443-2d9ab344eacc req-94697697-4f8b-44c2-8d18-ec3291e8001a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456975 Dec 20 05:57:11.814471 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-068a47d9-76da-44c6-9f45-fc25e0c9e602 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:11.816060 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-068a47d9-76da-44c6-9f45-fc25e0c9e602 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fca5c9c5-06df-4c64-840c-e8558a30dd3c HTTP/1.1" status: 200 len: 854 time: 0.0510092 Dec 20 05:57:11.879779 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-1db9bc64-6c02-4d26-b800-cd3ab41ff9cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:11.881283 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-1db9bc64-6c02-4d26-b800-cd3ab41ff9cb service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4e35b188-ad5c-4cae-9209-b7e538e3669f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0411406 Dec 20 05:57:11.982268 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-039994e5-d88c-4403-82b7-9cff2baeb006 service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0918751 Dec 20 05:57:12.082215 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-09ce063f-11b3-4088-bcc2-de83c91c6af6 req-a07bbc81-bf4e-4dfc-88c6-deb115dea3d6 service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0924590 Dec 20 05:57:12.348111 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a581125-a71a-4bc0-80ae-b0bfd806f76b req-6df51e3a-e9ed-4a3f-a088-6138fb20e07a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:12.349611 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-9a581125-a71a-4bc0-80ae-b0bfd806f76b req-6df51e3a-e9ed-4a3f-a088-6138fb20e07a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=627c52664e194163a380283ded298eb5&device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 1096 time: 0.0454745 Dec 20 05:57:12.416626 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23c93be9-3c43-406e-82c7-f7fdb7bc82b6 req-cf119794-3173-4ea4-a18a-6e34fc0650ab tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:12.418096 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-23c93be9-3c43-406e-82c7-f7fdb7bc82b6 req-cf119794-3173-4ea4-a18a-6e34fc0650ab tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 943 time: 0.0540571 Dec 20 05:57:12.462732 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a581125-a71a-4bc0-80ae-b0bfd806f76b req-613cf955-be52-4084-9e00-840195959af7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:12.464264 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-9a581125-a71a-4bc0-80ae-b0bfd806f76b req-613cf955-be52-4084-9e00-840195959af7 service neutron] 10.222.0.54 "GET /v2.0/networks?id=4e35b188-ad5c-4cae-9209-b7e538e3669f HTTP/1.1" status: 200 len: 916 time: 0.0919430 Dec 20 05:57:12.468616 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-23c93be9-3c43-406e-82c7-f7fdb7bc82b6 req-70ea9d71-5bf2-4d09-a54b-8e4da6ef2c1b tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442176 Dec 20 05:57:12.526078 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-9a581125-a71a-4bc0-80ae-b0bfd806f76b req-2403dab3-99df-455a-a09e-9575f0422892 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=18320379-21ed-4b2e-af2c-62b95cf39325 HTTP/1.1" status: 200 len: 217 time: 0.0388582 Dec 20 05:57:12.577622 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a581125-a71a-4bc0-80ae-b0bfd806f76b req-c9a8612f-e502-45ce-b182-87cd52157569 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:12.579217 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-9a581125-a71a-4bc0-80ae-b0bfd806f76b req-c9a8612f-e502-45ce-b182-87cd52157569 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fca5c9c5-06df-4c64-840c-e8558a30dd3c HTTP/1.1" status: 200 len: 854 time: 0.0429606 Dec 20 05:57:12.627199 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a581125-a71a-4bc0-80ae-b0bfd806f76b req-0bb7e44a-3320-49d8-adca-260de69e8d8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:12.628656 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-9a581125-a71a-4bc0-80ae-b0bfd806f76b req-0bb7e44a-3320-49d8-adca-260de69e8d8e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4e35b188-ad5c-4cae-9209-b7e538e3669f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0375149 Dec 20 05:57:12.719259 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-9a581125-a71a-4bc0-80ae-b0bfd806f76b req-2d23ff59-e788-4003-98ee-5f7bf32faca0 service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810742 Dec 20 05:57:12.861320 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0b7ac9-b9a0-49f7-8cdd-953b8aaf0897 req-523be118-d333-4b5e-b0cb-d5196173336f tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:12.862931 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bc0b7ac9-b9a0-49f7-8cdd-953b8aaf0897 req-523be118-d333-4b5e-b0cb-d5196173336f tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0479972 Dec 20 05:57:12.939964 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bc0b7ac9-b9a0-49f7-8cdd-953b8aaf0897 req-ec261268-9616-4d5b-b7aa-1ecce44ec841 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0707402 Dec 20 05:57:12.948886 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31a61a29-1982-49e8-abdd-60e882aeece6 req-b106672d-6749-4968-a9b7-e3e74f31b00f tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:12.950995 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-31a61a29-1982-49e8-abdd-60e882aeece6 req-b106672d-6749-4968-a9b7-e3e74f31b00f tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0833583 Dec 20 05:57:13.199391 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-31a61a29-1982-49e8-abdd-60e882aeece6 req-4e940350-9e6d-4082-9c3d-2cc101954ffe tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2410057 Dec 20 05:57:13.581042 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57699719-c280-4c25-aad4-cdde21ad78d9 req-81655eeb-05ba-4c27-9fa0-7b14fa2f891a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:13.582556 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-57699719-c280-4c25-aad4-cdde21ad78d9 req-81655eeb-05ba-4c27-9fa0-7b14fa2f891a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 943 time: 0.0478833 Dec 20 05:57:13.629453 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-57699719-c280-4c25-aad4-cdde21ad78d9 req-511b2669-37e0-4137-8ff7-eb180bf4c055 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408740 Dec 20 05:57:13.665524 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-9a581125-a71a-4bc0-80ae-b0bfd806f76b req-f77bd857-b250-497a-92de-24df334940a8 service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824611 Dec 20 05:57:14.309601 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5726a9c3-abc5-417e-86bf-99c2a69fd383 req-eb81d200-44f8-4372-8208-6c1165cf71b6 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:14.311041 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5726a9c3-abc5-417e-86bf-99c2a69fd383 req-eb81d200-44f8-4372-8208-6c1165cf71b6 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0470355 Dec 20 05:57:14.360058 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5726a9c3-abc5-417e-86bf-99c2a69fd383 req-8749cd28-5b21-4609-9fe1-62dd68c2d567 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432465 Dec 20 05:57:14.740692 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7524fa09-2ca5-4a6a-a61b-df8fdc7c15a7 req-5e46f89f-3a6a-4774-8afa-2fadda4fcfdb tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:14.742179 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7524fa09-2ca5-4a6a-a61b-df8fdc7c15a7 req-5e46f89f-3a6a-4774-8afa-2fadda4fcfdb tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 943 time: 0.0466743 Dec 20 05:57:14.789002 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7524fa09-2ca5-4a6a-a61b-df8fdc7c15a7 req-729b77e2-d420-4eac-8798-e03803f68009 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396402 Dec 20 05:57:15.472217 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-017ec4a1-84b9-4545-9698-4c392f72455a req-503f01f4-74df-4091-a5be-4fbbc7929e70 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:15.473759 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-017ec4a1-84b9-4545-9698-4c392f72455a req-503f01f4-74df-4091-a5be-4fbbc7929e70 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0481036 Dec 20 05:57:15.521132 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-017ec4a1-84b9-4545-9698-4c392f72455a req-78b7052a-e599-4278-8e59-b637874c6638 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401087 Dec 20 05:57:15.902067 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a24195-b042-4474-8bbf-af5954359eaa req-408986fb-794f-4ce6-ba50-9b74d7c173ba tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:15.903569 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e5a24195-b042-4474-8bbf-af5954359eaa req-408986fb-794f-4ce6-ba50-9b74d7c173ba tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 943 time: 0.0502577 Dec 20 05:57:15.949210 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e5a24195-b042-4474-8bbf-af5954359eaa req-afdfb4b1-6dd7-49f9-b2b0-08142895b029 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397577 Dec 20 05:57:16.642147 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96e14148-5d42-4169-89a3-106448105d97 req-38ade644-40db-44a7-8930-d9cdd61ca734 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:16.643710 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-96e14148-5d42-4169-89a3-106448105d97 req-38ade644-40db-44a7-8930-d9cdd61ca734 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0503325 Dec 20 05:57:16.688638 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-96e14148-5d42-4169-89a3-106448105d97 req-39ed8bb0-6ece-4d0e-87ed-4e9788a1d430 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385268 Dec 20 05:57:17.066086 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe139c05-2559-488d-a76e-090547af2b4a req-b9609a14-958a-4e61-b86f-624f0584dac4 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:17.067601 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fe139c05-2559-488d-a76e-090547af2b4a req-b9609a14-958a-4e61-b86f-624f0584dac4 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 943 time: 0.0507498 Dec 20 05:57:17.115981 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fe139c05-2559-488d-a76e-090547af2b4a req-9c0ef748-7476-4e5f-8590-08b66b314818 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419137 Dec 20 05:57:17.802775 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9234b296-8783-42e5-87a6-3d23c5d246f9 req-3154bc03-509b-49d1-a835-adc7b0a43113 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:17.804301 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9234b296-8783-42e5-87a6-3d23c5d246f9 req-3154bc03-509b-49d1-a835-adc7b0a43113 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0480845 Dec 20 05:57:17.849746 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9234b296-8783-42e5-87a6-3d23c5d246f9 req-c01eaf97-a6c5-4123-be62-e94363dbef86 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396910 Dec 20 05:57:18.226861 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a06848-66ee-47f8-9e52-86b3295fbf03 req-1e1f1ec3-964a-473d-9f5b-367591ddb6e6 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:18.228320 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-75a06848-66ee-47f8-9e52-86b3295fbf03 req-1e1f1ec3-964a-473d-9f5b-367591ddb6e6 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 943 time: 0.0464711 Dec 20 05:57:18.273158 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-75a06848-66ee-47f8-9e52-86b3295fbf03 req-67a5f22a-1a8c-42b2-99ed-acd20dccb023 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387638 Dec 20 05:57:18.966348 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f2347d-7607-47ae-8ed6-f928e92c5376 req-e005cab7-6127-45a3-8e70-049588c47d59 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:18.967811 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1f2347d-7607-47ae-8ed6-f928e92c5376 req-e005cab7-6127-45a3-8e70-049588c47d59 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0502412 Dec 20 05:57:19.017473 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1f2347d-7607-47ae-8ed6-f928e92c5376 req-5194c560-3044-4442-89d0-b1e73cc91b8c tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437944 Dec 20 05:57:19.383872 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba02fc9a-4fac-4948-8a12-986cda3208c6 req-ba3cb888-7483-43be-beb5-d7199f766fce tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:19.385358 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ba02fc9a-4fac-4948-8a12-986cda3208c6 req-ba3cb888-7483-43be-beb5-d7199f766fce tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 943 time: 0.0472341 Dec 20 05:57:19.432496 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ba02fc9a-4fac-4948-8a12-986cda3208c6 req-de247edd-ed45-4fd1-bb74-30949b223cbe tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412319 Dec 20 05:57:19.702340 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 18320379-21ed-4b2e-af2c-62b95cf39325 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:57:19.797609 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 18320379-21ed-4b2e-af2c-62b95cf39325, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=18320379-21ed-4b2e-af2c-62b95cf39325,segment=NetworkSegment(6a78353a-8122-4f87-a059-aadb4a3c82d5),segment_id=6a78353a-8122-4f87-a059-aadb4a3c82d5)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:57:19.808816 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '18320379-21ed-4b2e-af2c-62b95cf39325', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'port_id': '18320379-21ed-4b2e-af2c-62b95cf39325', 'mac_address': 'fa:16:3e:e5:2d:13', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 436, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:57:19.843889 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:19.859136 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 18320379-21ed-4b2e-af2c-62b95cf39325 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:57:19.877818 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 18320379-21ed-4b2e-af2c-62b95cf39325, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=18320379-21ed-4b2e-af2c-62b95cf39325,segment=NetworkSegment(6a78353a-8122-4f87-a059-aadb4a3c82d5),segment_id=6a78353a-8122-4f87-a059-aadb4a3c82d5)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:57:19.881401 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:19.925656 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=18320379-21ed-4b2e-af2c-62b95cf39325,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:19.932906 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:19.933272 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:19.933628 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:19.933963 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:19.934289 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:19.934613 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:19.934937 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:19.935256 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:19.935599 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:19.935941 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:19.936265 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:19.936580 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:19.936894 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:20.136676 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06be74dd-68a3-4f5b-bc65-71c17ef303a8 req-5c1060a1-c729-4c27-9977-085c7fea525d tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:20.138111 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-06be74dd-68a3-4f5b-bc65-71c17ef303a8 req-5c1060a1-c729-4c27-9977-085c7fea525d tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0523443 Dec 20 05:57:20.184859 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-06be74dd-68a3-4f5b-bc65-71c17ef303a8 req-1749f208-234a-4779-af65-d5daf7950ea3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408468 Dec 20 05:57:20.323169 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['18320379-21ed-4b2e-af2c-62b95cf39325'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:57:20.543656 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73148422-dca1-4b57-ae9d-a4678e472eb8 req-94932293-cb80-482c-bda1-7ebf2580d1f7 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:20.545126 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-73148422-dca1-4b57-ae9d-a4678e472eb8 req-94932293-cb80-482c-bda1-7ebf2580d1f7 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 944 time: 0.0472577 Dec 20 05:57:20.591383 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-73148422-dca1-4b57-ae9d-a4678e472eb8 req-fe1d08d0-1587-49c5-b99b-d90948d8a8ce tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403960 Dec 20 05:57:21.296545 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-909a3cb5-506c-430a-80da-55c24a2bacd0 req-030e6ad5-2783-4b91-b271-c511887d4caf tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:21.298000 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-909a3cb5-506c-430a-80da-55c24a2bacd0 req-030e6ad5-2783-4b91-b271-c511887d4caf tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0476472 Dec 20 05:57:21.347126 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-909a3cb5-506c-430a-80da-55c24a2bacd0 req-b6247425-d523-4a14-8bfe-b24ef3a41dba tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433693 Dec 20 05:57:21.702824 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-738bc7ba-fd0c-4ef0-8731-e30b26def185 req-68db7f40-1fb4-4b0c-bb54-7a2bf84dc1ca tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:21.704565 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-738bc7ba-fd0c-4ef0-8731-e30b26def185 req-68db7f40-1fb4-4b0c-bb54-7a2bf84dc1ca tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 944 time: 0.0467999 Dec 20 05:57:21.755370 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-738bc7ba-fd0c-4ef0-8731-e30b26def185 req-94e4adbc-fe0f-44c3-877a-fc9c3571b063 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444529 Dec 20 05:57:22.460185 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4ee6a16-0d44-4691-9658-a7465929bb96 req-877f4081-73d3-4beb-8a29-07333d1c4ea8 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:22.461649 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e4ee6a16-0d44-4691-9658-a7465929bb96 req-877f4081-73d3-4beb-8a29-07333d1c4ea8 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0477479 Dec 20 05:57:22.507459 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e4ee6a16-0d44-4691-9658-a7465929bb96 req-b8d1c9a3-25f6-4228-94a2-817e09342ca8 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393274 Dec 20 05:57:22.870880 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba3e450a-8eed-457c-b0aa-321135e27036 req-83fa127b-3c66-49e0-bde3-186fb9656236 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:22.872396 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ba3e450a-8eed-457c-b0aa-321135e27036 req-83fa127b-3c66-49e0-bde3-186fb9656236 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 944 time: 0.0520816 Dec 20 05:57:22.918226 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ba3e450a-8eed-457c-b0aa-321135e27036 req-bead3635-c14a-4e27-a7c7-97943bc2bdb8 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400541 Dec 20 05:57:23.619486 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f7c9ed4-b28c-423d-b621-735058366754 req-3005776f-3ac3-447c-bf1d-8e0103258760 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:23.620984 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0f7c9ed4-b28c-423d-b621-735058366754 req-3005776f-3ac3-447c-bf1d-8e0103258760 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0482309 Dec 20 05:57:23.666255 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0f7c9ed4-b28c-423d-b621-735058366754 req-d65f83a3-1137-4ba5-a3ee-382aeb130eaa tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393453 Dec 20 05:57:24.027321 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4341de9b-1daf-4974-b66b-45ff67d2238b req-0bb3815c-7312-4176-99fa-492f00ec8e16 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:24.028835 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4341de9b-1daf-4974-b66b-45ff67d2238b req-0bb3815c-7312-4176-99fa-492f00ec8e16 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 944 time: 0.0469103 Dec 20 05:57:24.077414 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4341de9b-1daf-4974-b66b-45ff67d2238b req-8aad0a69-96d5-4f69-b9fd-8b4f6439a3fb tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427599 Dec 20 05:57:24.740076 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 18320379-21ed-4b2e-af2c-62b95cf39325 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:57:24.779326 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58e518c8-343d-4fff-a9ca-1d34c8398b32 req-ffe77b89-7fbe-4460-bd3f-87dd1376b02e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:24.780883 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58e518c8-343d-4fff-a9ca-1d34c8398b32 req-ffe77b89-7fbe-4460-bd3f-87dd1376b02e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0483134 Dec 20 05:57:24.788619 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port 18320379-21ed-4b2e-af2c-62b95cf39325 completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 05:57:24.792926 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 18320379-21ed-4b2e-af2c-62b95cf39325 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:57:24.793288 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:24.828447 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58e518c8-343d-4fff-a9ca-1d34c8398b32 req-5a6b5853-2355-45b1-80fb-511110b8dda0 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416093 Dec 20 05:57:24.870569 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:24.892283 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '18320379-21ed-4b2e-af2c-62b95cf39325'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:57:24.894476 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c96ef9dd-c0a9-41ff-8b07-c14a9284ce65" -d '{"events": [{"server_uuid": "d315076f-1aa5-4b60-ade2-0210f6406b1d", "name": "network-vif-plugged", "status": "completed", "tag": "18320379-21ed-4b2e-af2c-62b95cf39325"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:57:24.908405 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 18320379-21ed-4b2e-af2c-62b95cf39325, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=18320379-21ed-4b2e-af2c-62b95cf39325,segment=NetworkSegment(6a78353a-8122-4f87-a059-aadb4a3c82d5),segment_id=6a78353a-8122-4f87-a059-aadb4a3c82d5)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:57:24.913340 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:24.937925 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:57:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-954d105e-6896-475c-8f16-6120eeaad830 x-openstack-request-id: req-954d105e-6896-475c-8f16-6120eeaad830 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:57:24.938217 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d315076f-1aa5-4b60-ade2-0210f6406b1d", "name": "network-vif-plugged", "status": "completed", "tag": "18320379-21ed-4b2e-af2c-62b95cf39325", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:57:24.938468 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-954d105e-6896-475c-8f16-6120eeaad830 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:57:24.938861 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '18320379-21ed-4b2e-af2c-62b95cf39325', 'code': 200} Dec 20 05:57:24.962837 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=18320379-21ed-4b2e-af2c-62b95cf39325,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:25.192655 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18c2beb9-830c-48e0-9096-110eeb7e54e6 req-34c6f819-ab92-4c10-b105-b738292f085d tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:25.194686 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-18c2beb9-830c-48e0-9096-110eeb7e54e6 req-34c6f819-ab92-4c10-b105-b738292f085d tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 945 time: 0.0496106 Dec 20 05:57:25.203411 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe03993a-7c92-4129-a6ef-f1d87db77080 req-4cfef5fe-2040-4605-b442-c979a4c1b939 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:25.205316 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-fe03993a-7c92-4129-a6ef-f1d87db77080 req-4cfef5fe-2040-4605-b442-c979a4c1b939 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 1098 time: 0.0458839 Dec 20 05:57:25.243843 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-18c2beb9-830c-48e0-9096-110eeb7e54e6 req-c6810f12-a2dc-43fe-8fd2-d4d681497f42 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432053 Dec 20 05:57:25.448862 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-fe03993a-7c92-4129-a6ef-f1d87db77080 req-8e257746-3f8d-4f92-9dba-655066bbd166 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2348170 Dec 20 05:57:25.946781 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71003dfc-4549-479d-b8c5-f017c38a5bf4 req-503a8309-4c9d-4f96-8c4f-bd4afeb0644b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:25.948266 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-71003dfc-4549-479d-b8c5-f017c38a5bf4 req-503a8309-4c9d-4f96-8c4f-bd4afeb0644b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0509617 Dec 20 05:57:25.993503 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-71003dfc-4549-479d-b8c5-f017c38a5bf4 req-fd506e10-8dc9-44a7-acf1-c99c910bdc3b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394154 Dec 20 05:57:26.357558 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34ef52a6-4be4-4f76-819f-bac3646b2da7 req-e0fc1f4f-420b-4bb0-88da-54d8c682f2ce tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:26.358999 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-34ef52a6-4be4-4f76-819f-bac3646b2da7 req-e0fc1f4f-420b-4bb0-88da-54d8c682f2ce tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 945 time: 0.0495126 Dec 20 05:57:26.405629 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-34ef52a6-4be4-4f76-819f-bac3646b2da7 req-b6b796de-8ef9-469b-86fa-dfbbef01abbb tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406725 Dec 20 05:57:27.115275 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be26d086-1e3a-412e-bc91-7a45e4b0570c req-30052591-7b23-4705-befc-13c2ebe72801 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:27.116869 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-be26d086-1e3a-412e-bc91-7a45e4b0570c req-30052591-7b23-4705-befc-13c2ebe72801 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0562596 Dec 20 05:57:27.166416 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-be26d086-1e3a-412e-bc91-7a45e4b0570c req-f1fb14bf-ea0a-4405-87b6-bbc3594b27ee tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420475 Dec 20 05:57:27.525460 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df849824-772b-44e2-afe2-6f874d821fab req-e52f5d32-0858-4e58-a1d4-1a3032fc87c1 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:27.526963 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-df849824-772b-44e2-afe2-6f874d821fab req-e52f5d32-0858-4e58-a1d4-1a3032fc87c1 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 945 time: 0.0534527 Dec 20 05:57:27.573255 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-df849824-772b-44e2-afe2-6f874d821fab req-5525a2db-b63d-4f6f-9b01-29e3418003ea tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404058 Dec 20 05:57:27.689096 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c42ec13-28e6-4f05-b581-604cd72b211a req-309e4aa9-d951-48ba-babd-f2440f5d05e3 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:27.690487 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5c42ec13-28e6-4f05-b581-604cd72b211a req-309e4aa9-d951-48ba-babd-f2440f5d05e3 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 945 time: 0.0498121 Dec 20 05:57:27.740317 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5c42ec13-28e6-4f05-b581-604cd72b211a req-ed74573a-8d4e-4b1d-b2da-09dd6fa54001 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439048 Dec 20 05:57:28.065431 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e63bf0ef-1f03-470b-bcb2-c3ac9fc50092 req-b11a5bdc-46ad-4431-aa46-7de2c971cdbe tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:28.066998 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e63bf0ef-1f03-470b-bcb2-c3ac9fc50092 req-b11a5bdc-46ad-4431-aa46-7de2c971cdbe tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 945 time: 0.0478351 Dec 20 05:57:28.113737 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e63bf0ef-1f03-470b-bcb2-c3ac9fc50092 req-98ecf17f-44d5-4af6-a26a-7eac50601719 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403383 Dec 20 05:57:28.293683 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c66009-c528-4eee-9190-911dd282e6c4 req-6a305789-4460-41b8-a3ed-4cb167f18944 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:28.295197 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f5c66009-c528-4eee-9190-911dd282e6c4 req-6a305789-4460-41b8-a3ed-4cb167f18944 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0578256 Dec 20 05:57:28.348055 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f5c66009-c528-4eee-9190-911dd282e6c4 req-daa539ea-62a7-4a32-8a89-41a2fea55ed6 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460501 Dec 20 05:57:29.483426 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2576f984-ed3e-4630-ab83-70c15cf82797 req-f29ef075-8f33-42ea-bfca-165d20133ea1 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:29.484941 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2576f984-ed3e-4630-ab83-70c15cf82797 req-f29ef075-8f33-42ea-bfca-165d20133ea1 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0531445 Dec 20 05:57:29.548904 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2576f984-ed3e-4630-ab83-70c15cf82797 req-0e03f736-400d-40b3-a0a1-06a16df1180a tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499659 Dec 20 05:57:30.665155 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbaea78e-6469-4789-ab03-e593f5b122c8 req-a27e2d3c-7248-42bc-a245-3673f6c63bb2 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:30.666782 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fbaea78e-6469-4789-ab03-e593f5b122c8 req-a27e2d3c-7248-42bc-a245-3673f6c63bb2 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0491571 Dec 20 05:57:30.720819 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fbaea78e-6469-4789-ab03-e593f5b122c8 req-6fc73c18-16c4-44b6-8236-057ce1f3a566 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478432 Dec 20 05:57:30.811267 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df595b3f-0192-4595-9bf6-665ca8e41c8b req-34fdba2e-f7eb-4111-9424-e775709337db tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:30.812796 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-df595b3f-0192-4595-9bf6-665ca8e41c8b req-34fdba2e-f7eb-4111-9424-e775709337db tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 945 time: 0.0498536 Dec 20 05:57:30.861902 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-df595b3f-0192-4595-9bf6-665ca8e41c8b req-23dcf4d0-945c-4e0e-9461-6a172766b904 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429721 Dec 20 05:57:31.710510 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-57748279-67a5-4d20-920e-c3470be292e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:31.839981 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fbd1d67-f4b1-484b-b00b-74f4128e6e6d req-029cc768-522a-48dc-ad26-b20a8dd8c9ae tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:31.841446 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6fbd1d67-f4b1-484b-b00b-74f4128e6e6d req-029cc768-522a-48dc-ad26-b20a8dd8c9ae tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0489051 Dec 20 05:57:31.888496 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6fbd1d67-f4b1-484b-b00b-74f4128e6e6d req-0899e69e-b5e5-4981-b328-8e293e43f284 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410931 Dec 20 05:57:31.982829 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c727aba7-2538-4155-8d10-178e94725ea0 req-13084f75-84c4-4d25-9f91-af934fa5d9c0 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:31.984224 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c727aba7-2538-4155-8d10-178e94725ea0 req-13084f75-84c4-4d25-9f91-af934fa5d9c0 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 945 time: 0.0512519 Dec 20 05:57:32.030402 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c727aba7-2538-4155-8d10-178e94725ea0 req-8cf12e18-783c-4fe8-a9eb-5e0964d16afa tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402923 Dec 20 05:57:32.838566 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee676711-69b5-4f64-a243-6d10ad758830 req-7493d7dd-49f4-43e3-a412-2f366f490fee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:32.839933 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-ee676711-69b5-4f64-a243-6d10ad758830 req-7493d7dd-49f4-43e3-a412-2f366f490fee service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 1098 time: 0.0384171 Dec 20 05:57:32.882803 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-ee676711-69b5-4f64-a243-6d10ad758830 req-f71362df-62e1-49d1-850d-fc77ecb41145 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0357065 Dec 20 05:57:33.006496 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-905d7473-ca96-4c54-a774-a069690b154c req-92037aaf-6825-4ac4-b837-1c252599282f tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:33.007985 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-905d7473-ca96-4c54-a774-a069690b154c req-92037aaf-6825-4ac4-b837-1c252599282f tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0507822 Dec 20 05:57:33.053752 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-905d7473-ca96-4c54-a774-a069690b154c req-9386b994-d529-4690-b08f-a6d28a98bd32 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399806 Dec 20 05:57:33.146425 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cfa0bc5-e59c-47af-afbd-40a44a53b229 req-a64b768f-ef9a-4130-a4ae-8b81d5f747d5 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:33.148556 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6cfa0bc5-e59c-47af-afbd-40a44a53b229 req-a64b768f-ef9a-4130-a4ae-8b81d5f747d5 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 945 time: 0.0517042 Dec 20 05:57:33.196290 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6cfa0bc5-e59c-47af-afbd-40a44a53b229 req-dd3d825a-a074-481f-ab9b-3e1320b0c1ed tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413752 Dec 20 05:57:33.312357 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c21dc8d-93b4-42db-927d-38965e3b2cdf req-f9efe56c-2a37-4330-bf8d-079d47b01156 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:33.313870 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-9c21dc8d-93b4-42db-927d-38965e3b2cdf req-f9efe56c-2a37-4330-bf8d-079d47b01156 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.54 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 945 time: 0.0460944 Dec 20 05:57:33.407534 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-9c21dc8d-93b4-42db-927d-38965e3b2cdf req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Deleting port bf46fd9d-2baf-433d-8177-480c5b1b86de {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:57:33.407882 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-9c21dc8d-93b4-42db-927d-38965e3b2cdf req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:33.491107 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-9c21dc8d-93b4-42db-927d-38965e3b2cdf req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] For port bf46fd9d-2baf-433d-8177-480c5b1b86de, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=bf46fd9d-2baf-433d-8177-480c5b1b86de,segment=NetworkSegment(62bdd930-d981-4fed-ad58-9d410d5c0393),segment_id=62bdd930-d981-4fed-ad58-9d410d5c0393)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:57:33.491460 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-9c21dc8d-93b4-42db-927d-38965e3b2cdf req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:33.503392 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-9c21dc8d-93b4-42db-927d-38965e3b2cdf req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Calling delete_port for bf46fd9d-2baf-433d-8177-480c5b1b86de owned by compute:nova {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:57:33.628576 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-9c21dc8d-93b4-42db-927d-38965e3b2cdf req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:33.655012 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Pushing event deleted for resources: {'Port': ['ID=bf46fd9d-2baf-433d-8177-480c5b1b86de,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:33.677841 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['bf46fd9d-2baf-433d-8177-480c5b1b86de'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:57:33.682866 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:33.683221 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:33.683593 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:33.683936 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:33.684273 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:33.684603 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:33.684933 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:33.685259 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:33.685584 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:33.685915 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:33.686238 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:33.686558 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:33.686878 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:57:33.711138 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-9c21dc8d-93b4-42db-927d-38965e3b2cdf req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] No DVR routers for this DVR port bf46fd9d-2baf-433d-8177-480c5b1b86de on host hv-cinder-82227 {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 05:57:33.713917 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-9c21dc8d-93b4-42db-927d-38965e3b2cdf req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:33.717283 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-9c21dc8d-93b4-42db-927d-38965e3b2cdf req-bdf42e4b-8de9-4fbe-8abd-524e8c24e518 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.54 "DELETE /v2.0/ports/bf46fd9d-2baf-433d-8177-480c5b1b86de HTTP/1.1" status: 204 len: 173 time: 0.3949490 Dec 20 05:57:33.717718 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '37b0a0f2-7827-455d-9224-50466a2eb445', 'name': 'network-vif-deleted', 'tag': 'bf46fd9d-2baf-433d-8177-480c5b1b86de'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:57:33.720102 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eca13b8a-703c-49ba-8b57-88548e51da94" -d '{"events": [{"server_uuid": "37b0a0f2-7827-455d-9224-50466a2eb445", "name": "network-vif-deleted", "tag": "bf46fd9d-2baf-433d-8177-480c5b1b86de"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:57:33.758058 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:57:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e631d9b9-7a4e-4666-84aa-91318bcac68d x-openstack-request-id: req-e631d9b9-7a4e-4666-84aa-91318bcac68d {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:57:33.758354 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "37b0a0f2-7827-455d-9224-50466a2eb445", "name": "network-vif-deleted", "tag": "bf46fd9d-2baf-433d-8177-480c5b1b86de", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:57:33.758610 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-e631d9b9-7a4e-4666-84aa-91318bcac68d {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:57:33.759006 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '37b0a0f2-7827-455d-9224-50466a2eb445', 'name': 'network-vif-deleted', 'tag': 'bf46fd9d-2baf-433d-8177-480c5b1b86de', 'status': 'completed', 'code': 200} Dec 20 05:57:34.147898 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-fbc564be-3c32-4a23-998b-03f9a70e405d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:34.181025 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-260feb42-d8a0-4249-8e45-51f17c1837f6 req-906e35bd-f712-4414-af8e-22336a311c00 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:34.182935 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-260feb42-d8a0-4249-8e45-51f17c1837f6 req-906e35bd-f712-4414-af8e-22336a311c00 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0601411 Dec 20 05:57:34.234251 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-260feb42-d8a0-4249-8e45-51f17c1837f6 req-cce919d1-69c4-49ed-961c-c2e8d8bf14a6 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430131 Dec 20 05:57:34.301236 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-51b50013-825a-4fe9-b872-ed2f430a4876 req-692758fb-f6ae-466e-9705-46398fcc879e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=37b0a0f2-7827-455d-9224-50466a2eb445 HTTP/1.1" status: 200 len: 210 time: 0.0254905 Dec 20 05:57:34.983341 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:35.346859 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-947fa103-5af8-48f3-881e-447b20b5d742 req-fd56ebd4-3524-48a4-9229-90360a62043c tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:35.348352 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-947fa103-5af8-48f3-881e-447b20b5d742 req-fd56ebd4-3524-48a4-9229-90360a62043c tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0472903 Dec 20 05:57:35.396737 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-947fa103-5af8-48f3-881e-447b20b5d742 req-4210e7de-6666-4822-ade8-927989c62589 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419965 Dec 20 05:57:35.758234 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b044c18-b7c0-44d2-a82f-6d77165ed035 req-81334431-01c8-4d67-a307-91a67df504c4 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:35.759752 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7b044c18-b7c0-44d2-a82f-6d77165ed035 req-81334431-01c8-4d67-a307-91a67df504c4 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0514200 Dec 20 05:57:35.805869 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7b044c18-b7c0-44d2-a82f-6d77165ed035 req-d739256a-518d-45af-b5fb-0794a5a23696 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402617 Dec 20 05:57:35.854165 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63cfef84-4d02-45a5-88df-f0f8393867a2 req-6ab3ed94-33cf-49e2-a68e-77fc2d993ad9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:35.855663 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-63cfef84-4d02-45a5-88df-f0f8393867a2 req-6ab3ed94-33cf-49e2-a68e-77fc2d993ad9 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a2e9de0d64e642f08bf90d402e77baa3&device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 1098 time: 0.0395086 Dec 20 05:57:36.472671 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:36.922538 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a22b273-6568-431a-9a1b-ff9c3afed8d0 req-9e472d35-2d7d-4098-9174-4ea0bf8c3979 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:36.924035 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3a22b273-6568-431a-9a1b-ff9c3afed8d0 req-9e472d35-2d7d-4098-9174-4ea0bf8c3979 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0479891 Dec 20 05:57:36.968339 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:57:36.975769 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3a22b273-6568-431a-9a1b-ff9c3afed8d0 req-1894057d-58e8-433a-876e-ffa360062e01 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452068 Dec 20 05:57:37.576577 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:37.701718 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63cfef84-4d02-45a5-88df-f0f8393867a2 req-565786da-79d6-4ef6-aef7-88a827892375 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:37.703205 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-63cfef84-4d02-45a5-88df-f0f8393867a2 req-565786da-79d6-4ef6-aef7-88a827892375 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a HTTP/1.1" status: 200 len: 920 time: 0.0868902 Dec 20 05:57:38.088179 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75b0430-f42b-4cbc-9189-628b0dfc35a8 req-57a1544e-94f1-4574-8609-e7cb25b8108b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:38.089652 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d75b0430-f42b-4cbc-9189-628b0dfc35a8 req-57a1544e-94f1-4574-8609-e7cb25b8108b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0472927 Dec 20 05:57:38.137275 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d75b0430-f42b-4cbc-9189-628b0dfc35a8 req-5ca45c7b-15b3-4237-bcf3-3a513f436bf8 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417533 Dec 20 05:57:38.659893 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device bf46fd9d-2baf-433d-8177-480c5b1b86de no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:57:38.682827 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: bf46fd9d-2baf-433d-8177-480c5b1b86de {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:57:38.683181 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device bf46fd9d-2baf-433d-8177-480c5b1b86de not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:57:38.695486 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:38.701737 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-63cfef84-4d02-45a5-88df-f0f8393867a2 req-15e2fc51-00e3-4808-8427-3d845597746c service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 HTTP/1.1" status: 200 len: 217 time: 0.0387430 Dec 20 05:57:38.750725 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63cfef84-4d02-45a5-88df-f0f8393867a2 req-3c6439d2-904c-4312-b413-277eaa8dca47 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:38.752163 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-63cfef84-4d02-45a5-88df-f0f8393867a2 req-3c6439d2-904c-4312-b413-277eaa8dca47 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=e1658c3d-4c2e-4687-a529-637456d3a81c HTTP/1.1" status: 200 len: 859 time: 0.0413508 Dec 20 05:57:38.785133 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-63cfef84-4d02-45a5-88df-f0f8393867a2 req-ae3b206b-af4d-47f4-84d7-d39437b8b78b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0229642 Dec 20 05:57:38.878552 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-63cfef84-4d02-45a5-88df-f0f8393867a2 req-0a702ae2-7d86-4cc4-9742-f252899d38ff service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826631 Dec 20 05:57:38.968045 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-63cfef84-4d02-45a5-88df-f0f8393867a2 req-145b2c69-cd3e-4326-80a7-0b45d09a9472 service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0792179 Dec 20 05:57:39.259153 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5b34a58-a973-42ad-a313-64c3728702b6 req-ca07e455-766b-44ab-9315-2c3b9683625b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:39.260565 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b5b34a58-a973-42ad-a313-64c3728702b6 req-ca07e455-766b-44ab-9315-2c3b9683625b tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0477691 Dec 20 05:57:39.306404 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b5b34a58-a973-42ad-a313-64c3728702b6 req-c14ef78c-c807-4ef4-8ccd-80a53f561d01 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400789 Dec 20 05:57:40.155105 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-b9f2b04b-0b92-4238-a8cc-bab395994dfd req-b68f2750-2d00-45e4-9a1c-f5af15b7b200 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0422225 Dec 20 05:57:40.229090 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f2b04b-0b92-4238-a8cc-bab395994dfd req-3aa8d1a0-6233-483f-b7d7-c64ea3123ba9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:40.230530 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-b9f2b04b-0b92-4238-a8cc-bab395994dfd req-3aa8d1a0-6233-483f-b7d7-c64ea3123ba9 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a2e9de0d64e642f08bf90d402e77baa3&device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 1098 time: 0.0387838 Dec 20 05:57:40.334099 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f2b04b-0b92-4238-a8cc-bab395994dfd req-9e93bceb-e13c-4a80-9658-95dc12d8e4f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:40.335411 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-b9f2b04b-0b92-4238-a8cc-bab395994dfd req-9e93bceb-e13c-4a80-9658-95dc12d8e4f0 service neutron] 10.222.0.54 "GET /v2.0/networks?id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a HTTP/1.1" status: 200 len: 920 time: 0.0851600 Dec 20 05:57:40.380328 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-b9f2b04b-0b92-4238-a8cc-bab395994dfd req-94b729b0-77fa-43b6-a915-74e752af9c83 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c HTTP/1.1" status: 200 len: 217 time: 0.0343857 Dec 20 05:57:40.421579 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ede544-98a4-4d88-98f9-918c0adf9902 req-4aa65580-b6ec-44b1-97ad-268276ba14a4 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:40.423066 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b2ede544-98a4-4d88-98f9-918c0adf9902 req-4aa65580-b6ec-44b1-97ad-268276ba14a4 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0487356 Dec 20 05:57:40.430996 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f2b04b-0b92-4238-a8cc-bab395994dfd req-2f035b8f-88f5-4373-a791-af0bf6162513 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:40.432467 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-b9f2b04b-0b92-4238-a8cc-bab395994dfd req-2f035b8f-88f5-4373-a791-af0bf6162513 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=e1658c3d-4c2e-4687-a529-637456d3a81c HTTP/1.1" status: 200 len: 859 time: 0.0433557 Dec 20 05:57:40.470408 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-b9f2b04b-0b92-4238-a8cc-bab395994dfd req-f4504c70-ea3b-41f6-9660-eec50658735f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0238175 Dec 20 05:57:40.471040 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b2ede544-98a4-4d88-98f9-918c0adf9902 req-57cc64af-fe39-4058-b022-b2cdf4a5dbf3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414162 Dec 20 05:57:40.575837 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-b9f2b04b-0b92-4238-a8cc-bab395994dfd req-8855351c-7e91-4bf6-9949-cf525256644a service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0965364 Dec 20 05:57:40.670442 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-b9f2b04b-0b92-4238-a8cc-bab395994dfd req-8d6f9634-1ded-4672-b63d-a80deecfa4bd service neutron] 10.222.0.54 "GET /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867422 Dec 20 05:57:40.701609 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cc7491d-82f8-4f4e-bcab-6db7cee86d99 req-bf4185f9-6d66-48ce-b76d-092a553f4792 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:40.702983 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2cc7491d-82f8-4f4e-bcab-6db7cee86d99 req-bf4185f9-6d66-48ce-b76d-092a553f4792 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 945 time: 0.0507636 Dec 20 05:57:40.749288 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2cc7491d-82f8-4f4e-bcab-6db7cee86d99 req-01fa029e-f62e-4865-bc82-56b4f21fa6a7 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401261 Dec 20 05:57:40.770686 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 47504) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:57:40.857880 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5c80f15-560c-49a9-8680-8fcc440b5a1a tempest-TestMinimumBasicScenario-2087274761 tempest-TestMinimumBasicScenario-2087274761-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:40.859388 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-b5c80f15-560c-49a9-8680-8fcc440b5a1a tempest-TestMinimumBasicScenario-2087274761 tempest-TestMinimumBasicScenario-2087274761-project-admin] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 1093 time: 0.0877125 Dec 20 05:57:40.862242 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 47512) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:57:40.867195 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Request body: {'floatingip': {'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'port_id': '18320379-21ed-4b2e-af2c-62b95cf39325', 'tenant_id': '627c52664e194163a380283ded298eb5', 'fixed_ip_address': '172.20.0.8'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:57:40.897682 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for floatingip, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:41.005168 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:41.108585 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Allocated IP 172.27.3.78 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/fd412670-e531-4fa6-b03b-dea2fe3b31a0) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:57:41.221198 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:41.257641 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:41.295291 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:57:41.298473 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:57:41.302005 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:57:41.327739 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event updated for resources: {'Port': ['ID=fd412670-e531-4fa6-b03b-dea2fe3b31a0,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:41.642459 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-585e8518-04c5-426d-b49e-5a86bbc50ead req-fbbeb507-f264-4064-acef-94806f217a30 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:41.643944 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-585e8518-04c5-426d-b49e-5a86bbc50ead req-fbbeb507-f264-4064-acef-94806f217a30 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0955739 Dec 20 05:57:41.723921 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:41.748502 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-585e8518-04c5-426d-b49e-5a86bbc50ead req-8909298a-b777-4e69-bda0-98b79c118189 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773544 Dec 20 05:57:41.794894 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:41.949734 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:41.954561 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:42.028809 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event updated for resources: {'Port': ['ID=fd412670-e531-4fa6-b03b-dea2fe3b31a0,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:42.039151 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:42.135581 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.l3_db [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Floating IP 345f873f-5237-43db-badd-ea1b7efa8c26 associated. External IP: 172.27.3.78, port: 18320379-21ed-4b2e-af2c-62b95cf39325. Dec 20 05:57:42.534272 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Router 62843140-b8ec-4625-b180-0cf2bab5498f has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:57:42.639715 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:57:42.649905 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aec27736-2740-450c-8426-92dd521a848d None None] Sync routers for ids ['62843140-b8ec-4625-b180-0cf2bab5498f'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:57:42.657155 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:42.659527 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aec27736-2740-450c-8426-92dd521a848d None None] Routers {'62843140-b8ec-4625-b180-0cf2bab5498f'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:57:42.660207 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-aec27736-2740-450c-8426-92dd521a848d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:57:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['62843140-b8ec-4625-b180-0cf2bab5498f'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:57:42.683769 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-986e0111-8d67-4dbc-8316-a10b74857fc0 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.8203290 Dec 20 05:57:42.684317 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'tag': '18320379-21ed-4b2e-af2c-62b95cf39325'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:57:42.686415 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47530) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:57:42.686880 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-09032480-669d-4ccb-b4dd-25186d5b6d9e" -d '{"events": [{"name": "network-changed", "server_uuid": "d315076f-1aa5-4b60-ade2-0210f6406b1d", "tag": "18320379-21ed-4b2e-af2c-62b95cf39325"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:57:42.690893 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-cf3780b1-bb90-4c53-a524-c1e65c44ddf8 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-589922421', 'description': 'tempest-secgroup-smoke-589922421 description', 'project_id': '627c52664e194163a380283ded298eb5'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:57:42.716095 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cf3780b1-bb90-4c53-a524-c1e65c44ddf8 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:42.726066 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:57:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cf21f5bb-dcbd-4676-baa0-d00f9ffb9a7d x-openstack-request-id: req-cf21f5bb-dcbd-4676-baa0-d00f9ffb9a7d {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:57:42.726358 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d315076f-1aa5-4b60-ade2-0210f6406b1d", "tag": "18320379-21ed-4b2e-af2c-62b95cf39325", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:57:42.726612 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-cf21f5bb-dcbd-4676-baa0-d00f9ffb9a7d {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:57:42.727035 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'tag': '18320379-21ed-4b2e-af2c-62b95cf39325', 'status': 'completed', 'code': 200} Dec 20 05:57:42.776055 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-aec27736-2740-450c-8426-92dd521a848d None None] Set router 62843140-b8ec-4625-b180-0cf2bab5498f gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:57:42.788705 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cf3780b1-bb90-4c53-a524-c1e65c44ddf8 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:42.792503 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cf3780b1-bb90-4c53-a524-c1e65c44ddf8 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:42.822780 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-cf3780b1-bb90-4c53-a524-c1e65c44ddf8 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:42.824046 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-cf3780b1-bb90-4c53-a524-c1e65c44ddf8 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1366282 Dec 20 05:57:42.825929 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf3780b1-bb90-4c53-a524-c1e65c44ddf8 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:42.827166 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 47534) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:57:42.832286 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-543d5204-3494-4412-ba88-25997b1e9caf tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Request body: {'security_group_rule': {'security_group_id': '5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2', 'project_id': '627c52664e194163a380283ded298eb5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:57:42.862644 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-543d5204-3494-4412-ba88-25997b1e9caf tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:42.943490 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-543d5204-3494-4412-ba88-25997b1e9caf tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:42.964449 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-543d5204-3494-4412-ba88-25997b1e9caf tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:42.983379 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-543d5204-3494-4412-ba88-25997b1e9caf tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dbfb3531-23a0-4096-914b-ed5bcd617094,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:42.991011 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-543d5204-3494-4412-ba88-25997b1e9caf tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:42.994743 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-543d5204-3494-4412-ba88-25997b1e9caf tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1639450 Dec 20 05:57:42.994940 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 47536) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:57:42.999207 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-0ec4d201-38e0-46a0-bdeb-0e1b15a94e41 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Request body: {'security_group_rule': {'security_group_id': '5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2', 'project_id': '627c52664e194163a380283ded298eb5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:57:43.015757 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-aec27736-2740-450c-8426-92dd521a848d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69'}], 'enable_snat': True}, 'gw_port_id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:56:36Z', 'revision_number': 4, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port': {'id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:96:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 484, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:34Z', 'updated_at': '2021-12-20T05:56:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '345f873f-5237-43db-badd-ea1b7efa8c26', 'tenant_id': '627c52664e194163a380283ded298eb5', 'floating_ip_address': '172.27.3.78', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'port_id': '18320379-21ed-4b2e-af2c-62b95cf39325', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 502, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'mac_address': 'fa:16:3e:e5:2d:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:57:41Z', 'updated_at': '2021-12-20T05:57:41Z', 'revision_number': 0, 'project_id': '627c52664e194163a380283ded298eb5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '526d693f-a680-4d0e-a26f-98f517a8db50', 'name': '', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'tenant_id': '627c52664e194163a380283ded298eb5', 'mac_address': 'fa:16:3e:cb:78:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_interface', 'standard_attr_id': 485, 'fixed_ips': [{'subnet_id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:36Z', 'updated_at': '2021-12-20T05:56:41Z', 'revision_number': 5, 'project_id': '627c52664e194163a380283ded298eb5', 'subnets': [{'id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:57:43.027306 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-0ec4d201-38e0-46a0-bdeb-0e1b15a94e41 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.095276 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-0ec4d201-38e0-46a0-bdeb-0e1b15a94e41 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.100446 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-0ec4d201-38e0-46a0-bdeb-0e1b15a94e41 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.118655 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ec4d201-38e0-46a0-bdeb-0e1b15a94e41 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7656405f-435e-432e-9bc8-752b8b4f7ddc,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:43.128827 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-0ec4d201-38e0-46a0-bdeb-0e1b15a94e41 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.133251 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47542) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:57:43.133504 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-0ec4d201-38e0-46a0-bdeb-0e1b15a94e41 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1375785 Dec 20 05:57:43.133671 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aec27736-2740-450c-8426-92dd521a848d None None] Checking router: 62843140-b8ec-4625-b180-0cf2bab5498f for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:57:43.138598 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-e8490a06-4045-49db-9dee-3cf9b5466957 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Request body: {'security_group_rule': {'security_group_id': '5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2', 'project_id': '627c52664e194163a380283ded298eb5', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:57:43.145620 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aec27736-2740-450c-8426-92dd521a848d None None] Routers {'62843140-b8ec-4625-b180-0cf2bab5498f'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:57:43.146320 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-aec27736-2740-450c-8426-92dd521a848d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:57:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['62843140-b8ec-4625-b180-0cf2bab5498f'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:57:43.170365 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e8490a06-4045-49db-9dee-3cf9b5466957 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.229342 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e8490a06-4045-49db-9dee-3cf9b5466957 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.233216 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e8490a06-4045-49db-9dee-3cf9b5466957 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.250489 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8490a06-4045-49db-9dee-3cf9b5466957 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=50e69172-c3c3-406e-852d-95d9edd760eb,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:43.255951 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-aec27736-2740-450c-8426-92dd521a848d None None] Set router 62843140-b8ec-4625-b180-0cf2bab5498f gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:57:43.260944 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e8490a06-4045-49db-9dee-3cf9b5466957 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.264652 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-e8490a06-4045-49db-9dee-3cf9b5466957 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1273563 Dec 20 05:57:43.264862 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47544) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:57:43.273594 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-c54f5ba6-8e00-4a5b-88e9-84a62408238c tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Request body: {'security_group_rule': {'security_group_id': '5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2', 'project_id': '627c52664e194163a380283ded298eb5', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:57:43.307675 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c54f5ba6-8e00-4a5b-88e9-84a62408238c tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.371427 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c54f5ba6-8e00-4a5b-88e9-84a62408238c tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.375133 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c54f5ba6-8e00-4a5b-88e9-84a62408238c tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.394946 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c54f5ba6-8e00-4a5b-88e9-84a62408238c tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9fc7da32-911e-47df-a01a-2b5311c4eb2c,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:43.400277 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c54f5ba6-8e00-4a5b-88e9-84a62408238c tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.401474 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-c54f5ba6-8e00-4a5b-88e9-84a62408238c tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1356649 Dec 20 05:57:43.404228 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47546) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:57:43.408449 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-370b94c2-4356-4839-9473-8c54db0fba07 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Request body: {'security_group_rule': {'security_group_id': '5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2', 'project_id': '627c52664e194163a380283ded298eb5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:57:43.432049 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.securitygroups_db [None req-370b94c2-4356-4839-9473-8c54db0fba07 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Project 627c52664e194163a380283ded298eb5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 20 05:57:43.436835 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-370b94c2-4356-4839-9473-8c54db0fba07 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.497133 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-370b94c2-4356-4839-9473-8c54db0fba07 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.497368 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-aec27736-2740-450c-8426-92dd521a848d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69'}], 'enable_snat': True}, 'gw_port_id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:56:36Z', 'revision_number': 4, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port': {'id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:96:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 484, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:34Z', 'updated_at': '2021-12-20T05:56:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '345f873f-5237-43db-badd-ea1b7efa8c26', 'tenant_id': '627c52664e194163a380283ded298eb5', 'floating_ip_address': '172.27.3.78', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'port_id': '18320379-21ed-4b2e-af2c-62b95cf39325', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 502, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'mac_address': 'fa:16:3e:e5:2d:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:57:41Z', 'updated_at': '2021-12-20T05:57:41Z', 'revision_number': 0, 'project_id': '627c52664e194163a380283ded298eb5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '526d693f-a680-4d0e-a26f-98f517a8db50', 'name': '', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'tenant_id': '627c52664e194163a380283ded298eb5', 'mac_address': 'fa:16:3e:cb:78:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_interface', 'standard_attr_id': 485, 'fixed_ips': [{'subnet_id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:36Z', 'updated_at': '2021-12-20T05:56:41Z', 'revision_number': 5, 'project_id': '627c52664e194163a380283ded298eb5', 'subnets': [{'id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:57:43.500885 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-370b94c2-4356-4839-9473-8c54db0fba07 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.518886 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-370b94c2-4356-4839-9473-8c54db0fba07 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ed8dcda7-095b-4c95-afde-b34364507fbf,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:43.526690 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-370b94c2-4356-4839-9473-8c54db0fba07 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.526905 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aec27736-2740-450c-8426-92dd521a848d None None] The sync data for ids ['62843140-b8ec-4625-b180-0cf2bab5498f'] in dv-cinder-822278-1-iscsi is: [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69'}], 'enable_snat': True}, 'gw_port_id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:56:36Z', 'revision_number': 4, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port': {'id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:96:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 484, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:34Z', 'updated_at': '2021-12-20T05:56:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '345f873f-5237-43db-badd-ea1b7efa8c26', 'tenant_id': '627c52664e194163a380283ded298eb5', 'floating_ip_address': '172.27.3.78', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'port_id': '18320379-21ed-4b2e-af2c-62b95cf39325', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 502, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'mac_address': 'fa:16:3e:e5:2d:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:57:41Z', 'updated_at': '2021-12-20T05:57:41Z', 'revision_number': 0, 'project_id': '627c52664e194163a380283ded298eb5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '526d693f-a680-4d0e-a26f-98f517a8db50', 'name': '', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'tenant_id': '627c52664e194163a380283ded298eb5', 'mac_address': 'fa:16:3e:cb:78:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_interface', 'standard_attr_id': 485, 'fixed_ips': [{'subnet_id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:36Z', 'updated_at': '2021-12-20T05:56:41Z', 'revision_number': 5, 'project_id': '627c52664e194163a380283ded298eb5', 'subnets': [{'id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:57:43.527896 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-370b94c2-4356-4839-9473-8c54db0fba07 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1227286 Dec 20 05:57:43.530568 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47548) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:57:43.534901 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-b3f47222-5f3c-4fd8-955f-7e51f3a511ee tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Request body: {'security_group_rule': {'security_group_id': '5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2', 'project_id': '627c52664e194163a380283ded298eb5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:57:43.559031 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.securitygroups_db [None req-b3f47222-5f3c-4fd8-955f-7e51f3a511ee tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Project 627c52664e194163a380283ded298eb5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 20 05:57:43.564090 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b3f47222-5f3c-4fd8-955f-7e51f3a511ee tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.623919 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b3f47222-5f3c-4fd8-955f-7e51f3a511ee tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.627273 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b3f47222-5f3c-4fd8-955f-7e51f3a511ee tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.645968 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3f47222-5f3c-4fd8-955f-7e51f3a511ee tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ef2ca59a-e09b-41d4-a809-43a701133b28,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:43.650918 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b3f47222-5f3c-4fd8-955f-7e51f3a511ee tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:43.652142 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-b3f47222-5f3c-4fd8-955f-7e51f3a511ee tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1206551 Dec 20 05:57:43.731312 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1c032bd-3bc0-4ea1-85eb-7f2772e7d7f6 None None] New status for floating IP 345f873f-5237-43db-badd-ea1b7efa8c26: ACTIVE {{(pid=102447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 05:57:43.746600 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb4ec021-4a46-4b1a-be24-a8d744f9553d req-3115c52d-cb93-49fd-ba34-d31e9284063a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-589922421&fields=id&tenant_id=627c52664e194163a380283ded298eb5 HTTP/1.1" status: 200 len: 267 time: 0.0470328 Dec 20 05:57:43.798149 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb4ec021-4a46-4b1a-be24-a8d744f9553d req-6654e4ab-1555-4821-9c8a-a57d3f78afb8 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:43.799501 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb4ec021-4a46-4b1a-be24-a8d744f9553d req-6654e4ab-1555-4821-9c8a-a57d3f78afb8 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 945 time: 0.0471580 Dec 20 05:57:43.810432 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-bb4ec021-4a46-4b1a-be24-a8d744f9553d req-ec9e17d7-7178-4c60-9691-72305eac33fc tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Request body: {'port': {'security_groups': ['4484ae16-a55f-40cc-bf6a-ad8ea50924e2', '5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2']}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:57:43.877759 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-bb4ec021-4a46-4b1a-be24-a8d744f9553d req-ec9e17d7-7178-4c60-9691-72305eac33fc tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:44.060550 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-bb4ec021-4a46-4b1a-be24-a8d744f9553d req-ec9e17d7-7178-4c60-9691-72305eac33fc tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] For port 18320379-21ed-4b2e-af2c-62b95cf39325, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=18320379-21ed-4b2e-af2c-62b95cf39325,segment=NetworkSegment(6a78353a-8122-4f87-a059-aadb4a3c82d5),segment_id=6a78353a-8122-4f87-a059-aadb4a3c82d5)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:57:44.090145 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-bb4ec021-4a46-4b1a-be24-a8d744f9553d req-ec9e17d7-7178-4c60-9691-72305eac33fc tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:44.094602 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-bb4ec021-4a46-4b1a-be24-a8d744f9553d req-ec9e17d7-7178-4c60-9691-72305eac33fc tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:44.138596 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb4ec021-4a46-4b1a-be24-a8d744f9553d req-ec9e17d7-7178-4c60-9691-72305eac33fc tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:44.139258 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-bb4ec021-4a46-4b1a-be24-a8d744f9553d req-ec9e17d7-7178-4c60-9691-72305eac33fc tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:44.140669 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb4ec021-4a46-4b1a-be24-a8d744f9553d req-ec9e17d7-7178-4c60-9691-72305eac33fc tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "PUT /v2.0/ports/18320379-21ed-4b2e-af2c-62b95cf39325 HTTP/1.1" status: 200 len: 981 time: 0.3345501 Dec 20 05:57:44.161910 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec9e17d7-7178-4c60-9691-72305eac33fc tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event updated for resources: {'Port': ['ID=18320379-21ed-4b2e-af2c-62b95cf39325,revision_number=6']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:44.195201 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09032480-669d-4ccb-b4dd-25186d5b6d9e req-d7c6f407-0478-4ec5-ae0e-bbb5dddb9980 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:44.196805 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-09032480-669d-4ccb-b4dd-25186d5b6d9e req-d7c6f407-0478-4ec5-ae0e-bbb5dddb9980 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=627c52664e194163a380283ded298eb5&device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 1137 time: 0.0596471 Dec 20 05:57:44.230792 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['18320379-21ed-4b2e-af2c-62b95cf39325'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:57:44.268896 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9744473-8928-4150-a448-feaa8c3bbff9 req-5298ecb6-6a17-416e-8350-7d9491652727 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:44.280374 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d9744473-8928-4150-a448-feaa8c3bbff9 req-5298ecb6-6a17-416e-8350-7d9491652727 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.0638235 Dec 20 05:57:44.305446 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09032480-669d-4ccb-b4dd-25186d5b6d9e req-f7aa4ce2-af41-4322-9cbb-1c8ab6a5f9a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:44.306942 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-09032480-669d-4ccb-b4dd-25186d5b6d9e req-f7aa4ce2-af41-4322-9cbb-1c8ab6a5f9a3 service neutron] 10.222.0.54 "GET /v2.0/networks?id=4e35b188-ad5c-4cae-9209-b7e538e3669f HTTP/1.1" status: 200 len: 916 time: 0.0997157 Dec 20 05:57:44.361303 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d9744473-8928-4150-a448-feaa8c3bbff9 req-a1104c63-adaf-4010-8528-eb9a3dd99572 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0797901 Dec 20 05:57:44.413829 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-09032480-669d-4ccb-b4dd-25186d5b6d9e req-25bce50f-1c60-4511-b141-dc7781c3af3e service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=18320379-21ed-4b2e-af2c-62b95cf39325 HTTP/1.1" status: 200 len: 1000 time: 0.0892758 Dec 20 05:57:44.469490 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09032480-669d-4ccb-b4dd-25186d5b6d9e req-dc21d283-b5b5-43d8-b5d5-18cb3015fd21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:44.470857 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-09032480-669d-4ccb-b4dd-25186d5b6d9e req-dc21d283-b5b5-43d8-b5d5-18cb3015fd21 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fca5c9c5-06df-4c64-840c-e8558a30dd3c HTTP/1.1" status: 200 len: 854 time: 0.0460062 Dec 20 05:57:44.489208 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['18320379-21ed-4b2e-af2c-62b95cf39325'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:57:44.521927 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09032480-669d-4ccb-b4dd-25186d5b6d9e req-587d392f-e2de-4b84-acf9-078fa637b6a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:44.523414 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-09032480-669d-4ccb-b4dd-25186d5b6d9e req-587d392f-e2de-4b84-acf9-078fa637b6a3 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4e35b188-ad5c-4cae-9209-b7e538e3669f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0383377 Dec 20 05:57:44.526792 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-afeb7bea-a2e0-4c67-bdf3-ccd7cae68e3b None None] Provisioning complete for port 18320379-21ed-4b2e-af2c-62b95cf39325 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:57:44.527164 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-afeb7bea-a2e0-4c67-bdf3-ccd7cae68e3b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:44.618719 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-09032480-669d-4ccb-b4dd-25186d5b6d9e req-3c950211-bd8b-441e-aadf-b079fbf8bdb9 service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0876198 Dec 20 05:57:44.715290 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-09032480-669d-4ccb-b4dd-25186d5b6d9e req-03e2e792-7527-4ae3-8f02-ad47c5b8ff37 service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859141 Dec 20 05:57:44.727807 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'tag': '18320379-21ed-4b2e-af2c-62b95cf39325'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:57:44.730262 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af6d24f4-4307-4499-89e6-43fcf603ebcc" -d '{"events": [{"name": "network-changed", "server_uuid": "d315076f-1aa5-4b60-ade2-0210f6406b1d", "tag": "18320379-21ed-4b2e-af2c-62b95cf39325"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:57:44.781740 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:57:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f1e5445-fbf5-4d9e-8fd9-1a56802a2839 x-openstack-request-id: req-7f1e5445-fbf5-4d9e-8fd9-1a56802a2839 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:57:44.782332 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d315076f-1aa5-4b60-ade2-0210f6406b1d", "tag": "18320379-21ed-4b2e-af2c-62b95cf39325", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:57:44.782332 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-7f1e5445-fbf5-4d9e-8fd9-1a56802a2839 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:57:44.783550 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'tag': '18320379-21ed-4b2e-af2c-62b95cf39325', 'status': 'completed', 'code': 200} Dec 20 05:57:44.876325 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6d24f4-4307-4499-89e6-43fcf603ebcc req-89283900-e3e8-4d38-a81a-eb988457dcf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:44.877705 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-af6d24f4-4307-4499-89e6-43fcf603ebcc req-89283900-e3e8-4d38-a81a-eb988457dcf2 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=627c52664e194163a380283ded298eb5&device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 1137 time: 0.0383196 Dec 20 05:57:44.988863 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6d24f4-4307-4499-89e6-43fcf603ebcc req-8b3005d7-e9a3-45df-ae85-5217ded46856 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:44.991201 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-af6d24f4-4307-4499-89e6-43fcf603ebcc req-8b3005d7-e9a3-45df-ae85-5217ded46856 service neutron] 10.222.0.54 "GET /v2.0/networks?id=4e35b188-ad5c-4cae-9209-b7e538e3669f HTTP/1.1" status: 200 len: 916 time: 0.0920067 Dec 20 05:57:45.061117 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-af6d24f4-4307-4499-89e6-43fcf603ebcc req-db273360-6f47-48af-af3e-9cc5b9502863 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=18320379-21ed-4b2e-af2c-62b95cf39325 HTTP/1.1" status: 200 len: 1000 time: 0.0572546 Dec 20 05:57:45.114435 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6d24f4-4307-4499-89e6-43fcf603ebcc req-69bb110a-3405-4883-bf07-53c0ece5983c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:45.116530 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-af6d24f4-4307-4499-89e6-43fcf603ebcc req-69bb110a-3405-4883-bf07-53c0ece5983c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fca5c9c5-06df-4c64-840c-e8558a30dd3c HTTP/1.1" status: 200 len: 854 time: 0.0463028 Dec 20 05:57:45.167654 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6d24f4-4307-4499-89e6-43fcf603ebcc req-32a66594-0714-4692-944d-8361e2618f95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:45.169372 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-af6d24f4-4307-4499-89e6-43fcf603ebcc req-32a66594-0714-4692-944d-8361e2618f95 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4e35b188-ad5c-4cae-9209-b7e538e3669f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0400066 Dec 20 05:57:45.278616 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-af6d24f4-4307-4499-89e6-43fcf603ebcc req-a479efde-8c37-4e7e-825b-00111911a34b service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1009431 Dec 20 05:57:45.373540 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-af6d24f4-4307-4499-89e6-43fcf603ebcc req-d9eb1fb4-ae64-4705-b114-f9633642924c service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862892 Dec 20 05:57:45.395618 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-8656bcff-7c2f-4c5d-aa4f-a301d1b2242a tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:45.397040 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-8656bcff-7c2f-4c5d-aa4f-a301d1b2242a tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/networks?id=9da693b1-1216-4020-9114-46c9936e8a72 HTTP/1.1" status: 200 len: 813 time: 0.1118410 Dec 20 05:57:45.411478 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-bbca8f1b-163e-4174-9316-96df29f113cb tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/quotas/a0ce0dc0b4da4cb093e9599f5cddd0c9 HTTP/1.1" status: 200 len: 375 time: 0.0088022 Dec 20 05:57:45.443420 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-90fd3437-a5ec-44c1-8a8b-ddc9069a8d42 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=a0ce0dc0b4da4cb093e9599f5cddd0c9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0259254 Dec 20 05:57:45.533715 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-95f9b299-58f7-431e-a83c-d6894e2695c3 service neutron] 10.222.0.46 "GET /v2.0/networks/9da693b1-1216-4020-9114-46c9936e8a72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832577 Dec 20 05:57:45.620799 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-5950dc89-667e-470a-8f59-2f4c1dca07cc service neutron] 10.222.0.46 "GET /v2.0/networks/9da693b1-1216-4020-9114-46c9936e8a72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0810692 Dec 20 05:57:45.776161 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-777f7f69-322c-4d51-972c-43ef5993e3b9 req-a217f5b4-83dc-4700-ab3b-c3fb6704984a tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 210 time: 0.0296094 Dec 20 05:57:46.883486 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-18750225-f5f0-4fce-82a3-c1c70c25104a req-88ec5d7f-a9ed-4e0e-85a9-87a829bda83a tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 210 time: 0.0395792 Dec 20 05:57:46.924768 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-fb609540-b6d4-40b1-8843-066089e1f43e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:46.926202 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-fb609540-b6d4-40b1-8843-066089e1f43e tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.54 "GET /v2.0/networks?id=9da693b1-1216-4020-9114-46c9936e8a72 HTTP/1.1" status: 200 len: 813 time: 0.1296170 Dec 20 05:57:46.965757 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-86790828-425b-4bd2-b105-712c305a6656 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Request body: {'port': {'device_id': 'd63d89bf-797a-4e53-b11e-6dd04664529f', 'network_id': '9da693b1-1216-4020-9114-46c9936e8a72', 'admin_state_up': True, 'tenant_id': 'a0ce0dc0b4da4cb093e9599f5cddd0c9'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:57:47.071962 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-86790828-425b-4bd2-b105-712c305a6656 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Made reservation on behalf of a0ce0dc0b4da4cb093e9599f5cddd0c9 for: {'port': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:57:47.075329 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-86790828-425b-4bd2-b105-712c305a6656 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:47.198059 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-86790828-425b-4bd2-b105-712c305a6656 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Allocated IP 172.20.0.12 (9da693b1-1216-4020-9114-46c9936e8a72/8265e939-4727-4318-be2f-9d57754a238e/ba178573-06ff-41da-95d0-ecc4c7c453b9) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:57:47.350660 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-86790828-425b-4bd2-b105-712c305a6656 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:47.384811 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-86790828-425b-4bd2-b105-712c305a6656 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:47.428604 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-86790828-425b-4bd2-b105-712c305a6656 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Network 9da693b1-1216-4020-9114-46c9936e8a72 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:57:47.432114 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-86790828-425b-4bd2-b105-712c305a6656 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:57:47.435593 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-86790828-425b-4bd2-b105-712c305a6656 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:57:47.441683 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86790828-425b-4bd2-b105-712c305a6656 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Pushing event updated for resources: {'Port': ['ID=ba178573-06ff-41da-95d0-ecc4c7c453b9,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:47.484606 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-86790828-425b-4bd2-b105-712c305a6656 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:47.485418 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-86790828-425b-4bd2-b105-712c305a6656 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:47.501475 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-86790828-425b-4bd2-b105-712c305a6656 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5393665 Dec 20 05:57:47.521086 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Request body: {'port': {'device_id': 'd63d89bf-797a-4e53-b11e-6dd04664529f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:57:47.579061 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:47.850730 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ba178573-06ff-41da-95d0-ecc4c7c453b9 {{(pid=102446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:57:47.858906 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:47.871466 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.provisioning_blocks [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Transition to ACTIVE for port object ba178573-06ff-41da-95d0-ecc4c7c453b9 will not be triggered until provisioned by entity L2. {{(pid=102446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 05:57:47.874978 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:47.923618 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Pushing event updated for resources: {'Port': ['ID=ba178573-06ff-41da-95d0-ecc4c7c453b9,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:48.007595 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Attempting to bind port ba178573-06ff-41da-95d0-ecc4c7c453b9 on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:57:48.008315 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Attempting to bind port ba178573-06ff-41da-95d0-ecc4c7c453b9 by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': '62bdd930-d981-4fed-ad58-9d410d5c0393', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 418, 'network_id': '9da693b1-1216-4020-9114-46c9936e8a72'}] {{(pid=102446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:57:48.008315 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Attempting to bind port ba178573-06ff-41da-95d0-ecc4c7c453b9 on network 9da693b1-1216-4020-9114-46c9936e8a72 {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:57:48.012499 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Port ba178573-06ff-41da-95d0-ecc4c7c453b9 on network 9da693b1-1216-4020-9114-46c9936e8a72 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 05:57:48.012822 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Attempting to bind port ba178573-06ff-41da-95d0-ecc4c7c453b9 on network 9da693b1-1216-4020-9114-46c9936e8a72 {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:57:48.013619 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcf206a3-e452-4888-9a1a-f597bd748f05 req-70cc3428-21ea-4ff9-89c4-a8fdf421c1c5 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:48.015115 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bcf206a3-e452-4888-9a1a-f597bd748f05 req-70cc3428-21ea-4ff9-89c4-a8fdf421c1c5 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 944 time: 0.0472789 Dec 20 05:57:48.017770 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 57, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:57:48.018141 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Checking segment: {'id': '62bdd930-d981-4fed-ad58-9d410d5c0393', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 418, 'network_id': '9da693b1-1216-4020-9114-46c9936e8a72'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:57:48.018618 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Bound using segment: {'id': '62bdd930-d981-4fed-ad58-9d410d5c0393', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 418, 'network_id': '9da693b1-1216-4020-9114-46c9936e8a72'} {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:57:48.019050 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Bound port: ba178573-06ff-41da-95d0-ecc4c7c453b9, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '62bdd930-d981-4fed-ad58-9d410d5c0393', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 418, 'network_id': '9da693b1-1216-4020-9114-46c9936e8a72'}}] {{(pid=102446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:57:48.019396 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:48.062681 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bcf206a3-e452-4888-9a1a-f597bd748f05 req-b2ff7afb-9730-480a-a21d-8c72c546ea16 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410619 Dec 20 05:57:48.095974 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] For port ba178573-06ff-41da-95d0-ecc4c7c453b9, host hv-cinder-82227, cleared binding levels {{(pid=102446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:57:48.099054 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] For port ba178573-06ff-41da-95d0-ecc4c7c453b9, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=ba178573-06ff-41da-95d0-ecc4c7c453b9,segment=NetworkSegment(62bdd930-d981-4fed-ad58-9d410d5c0393),segment_id=62bdd930-d981-4fed-ad58-9d410d5c0393)] {{(pid=102446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:57:48.104401 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:48.135882 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:48.136496 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:48.137879 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] 10.222.0.54 "PUT /v2.0/ports/ba178573-06ff-41da-95d0-ecc4c7c453b9 HTTP/1.1" status: 200 len: 1094 time: 0.6211894 Dec 20 05:57:48.138299 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd63d89bf-797a-4e53-b11e-6dd04664529f', 'tag': 'ba178573-06ff-41da-95d0-ecc4c7c453b9'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:57:48.140529 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-892dc366-413f-4d0c-bd16-ceaa4b7aa4c1" -d '{"events": [{"name": "network-changed", "server_uuid": "d63d89bf-797a-4e53-b11e-6dd04664529f", "tag": "ba178573-06ff-41da-95d0-ecc4c7c453b9"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:57:48.167748 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8758884-4287-4528-95d5-48c3c48f0db9 service neutron] Pushing event updated for resources: {'Port': ['ID=ba178573-06ff-41da-95d0-ecc4c7c453b9,revision_number=3']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:48.180917 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:57:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-570bd9b8-b710-4063-b574-83e108f003c3 x-openstack-request-id: req-570bd9b8-b710-4063-b574-83e108f003c3 {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:57:48.181213 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d63d89bf-797a-4e53-b11e-6dd04664529f", "tag": "ba178573-06ff-41da-95d0-ecc4c7c453b9", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:57:48.181503 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-570bd9b8-b710-4063-b574-83e108f003c3 {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:57:48.181901 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd63d89bf-797a-4e53-b11e-6dd04664529f', 'tag': 'ba178573-06ff-41da-95d0-ecc4c7c453b9', 'status': 'completed', 'code': 200} Dec 20 05:57:48.254267 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-860a2246-a5ff-4f78-a9e6-a5f61b09dded service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:48.255728 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-860a2246-a5ff-4f78-a9e6-a5f61b09dded service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a0ce0dc0b4da4cb093e9599f5cddd0c9&device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 1097 time: 0.0384703 Dec 20 05:57:48.316466 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-51110645-40aa-40a6-9a97-f7e245a504ce service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ba178573-06ff-41da-95d0-ecc4c7c453b9 HTTP/1.1" status: 200 len: 217 time: 0.0349457 Dec 20 05:57:48.365580 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-fa14c934-cbe9-4d8d-a0af-e5567870e527 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:48.366867 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-fa14c934-cbe9-4d8d-a0af-e5567870e527 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8265e939-4727-4318-be2f-9d57754a238e HTTP/1.1" status: 200 len: 853 time: 0.0405817 Dec 20 05:57:48.399737 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-c0410ef1-930a-48c2-9f9f-0e37105e2aec service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=9da693b1-1216-4020-9114-46c9936e8a72&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0240293 Dec 20 05:57:48.490430 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-5fa4c20e-f50a-4919-a932-d54bd9bb7fe4 service neutron] 10.222.0.54 "GET /v2.0/networks/9da693b1-1216-4020-9114-46c9936e8a72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0835912 Dec 20 05:57:48.577131 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-4e08a55c-5ba4-4440-b2cf-ad1492fbd708 req-d873d8ce-bce0-41ad-8c6a-312a446fe860 service neutron] 10.222.0.54 "GET /v2.0/networks/9da693b1-1216-4020-9114-46c9936e8a72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0789824 Dec 20 05:57:48.725210 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892dc366-413f-4d0c-bd16-ceaa4b7aa4c1 req-86061408-43d1-4ed0-92dc-0b7a57192761 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:48.726974 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-892dc366-413f-4d0c-bd16-ceaa4b7aa4c1 req-86061408-43d1-4ed0-92dc-0b7a57192761 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a0ce0dc0b4da4cb093e9599f5cddd0c9&device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 1097 time: 0.0482519 Dec 20 05:57:48.817997 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892dc366-413f-4d0c-bd16-ceaa4b7aa4c1 req-109653ff-6df3-44c6-9a3e-dd46e0c57fca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:48.819592 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-892dc366-413f-4d0c-bd16-ceaa4b7aa4c1 req-109653ff-6df3-44c6-9a3e-dd46e0c57fca service neutron] 10.222.0.54 "GET /v2.0/networks?id=9da693b1-1216-4020-9114-46c9936e8a72 HTTP/1.1" status: 200 len: 914 time: 0.0842102 Dec 20 05:57:48.826656 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07ac578-a61f-408a-b2d2-1e15b9f54762 req-6433b8b3-ad4a-4453-af3e-a84ae88f3085 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:48.828170 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f07ac578-a61f-408a-b2d2-1e15b9f54762 req-6433b8b3-ad4a-4453-af3e-a84ae88f3085 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0479350 Dec 20 05:57:48.867733 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-892dc366-413f-4d0c-bd16-ceaa4b7aa4c1 req-ebb9fdd6-7c1a-416c-ad4d-cf0c0807b10d service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ba178573-06ff-41da-95d0-ecc4c7c453b9 HTTP/1.1" status: 200 len: 217 time: 0.0386827 Dec 20 05:57:48.879497 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f07ac578-a61f-408a-b2d2-1e15b9f54762 req-5098dc21-8b36-45a5-bb2a-fae9b6ec9a37 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449107 Dec 20 05:57:48.919802 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892dc366-413f-4d0c-bd16-ceaa4b7aa4c1 req-3080d8cf-9952-437e-952d-91166c65bc40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:48.921286 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-892dc366-413f-4d0c-bd16-ceaa4b7aa4c1 req-3080d8cf-9952-437e-952d-91166c65bc40 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=8265e939-4727-4318-be2f-9d57754a238e HTTP/1.1" status: 200 len: 853 time: 0.0449524 Dec 20 05:57:48.953881 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-892dc366-413f-4d0c-bd16-ceaa4b7aa4c1 req-ee3bdbb2-a5ec-4fef-918c-3830f288c5d9 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=9da693b1-1216-4020-9114-46c9936e8a72&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0223877 Dec 20 05:57:49.051415 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-892dc366-413f-4d0c-bd16-ceaa4b7aa4c1 req-4e345316-c2c5-4ef4-a295-e4196f18ae3d service neutron] 10.222.0.54 "GET /v2.0/networks/9da693b1-1216-4020-9114-46c9936e8a72?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0809238 Dec 20 05:57:49.143045 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-892dc366-413f-4d0c-bd16-ceaa4b7aa4c1 req-e0d3a78d-e976-488b-b839-8a37bce41ead service neutron] 10.222.0.54 "GET /v2.0/networks/9da693b1-1216-4020-9114-46c9936e8a72?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0802157 Dec 20 05:57:49.176700 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42406a67-dd34-4736-a55e-7928280a53be req-29bdc01f-d66a-4aa7-a0b8-2522fd158000 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:49.178169 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42406a67-dd34-4736-a55e-7928280a53be req-29bdc01f-d66a-4aa7-a0b8-2522fd158000 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 944 time: 0.0472717 Dec 20 05:57:49.224027 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-42406a67-dd34-4736-a55e-7928280a53be req-c6d32200-ca1b-48f0-baaf-cd7ef40c2d2a tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392163 Dec 20 05:57:49.995692 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c026c4d-ad36-49f9-b6b9-9b0bae359929 req-ec075c34-481a-47b8-8b07-9fa129459e36 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:49.997151 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8c026c4d-ad36-49f9-b6b9-9b0bae359929 req-ec075c34-481a-47b8-8b07-9fa129459e36 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0515919 Dec 20 05:57:50.042185 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8c026c4d-ad36-49f9-b6b9-9b0bae359929 req-d4e8fbae-50be-44c5-8b65-423a38faffc4 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392532 Dec 20 05:57:50.338524 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a448c34d-497a-4175-8d01-a37ef4ac814f req-48d8858c-a582-4aa1-8e8c-9e87a40d2605 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:50.339979 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a448c34d-497a-4175-8d01-a37ef4ac814f req-48d8858c-a582-4aa1-8e8c-9e87a40d2605 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 944 time: 0.0502493 Dec 20 05:57:50.385190 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a448c34d-497a-4175-8d01-a37ef4ac814f req-47342ba8-e1ca-414c-aa56-fc2920224281 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393341 Dec 20 05:57:50.910444 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device ba178573-06ff-41da-95d0-ecc4c7c453b9 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:57:51.008860 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port ba178573-06ff-41da-95d0-ecc4c7c453b9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=ba178573-06ff-41da-95d0-ecc4c7c453b9,segment=NetworkSegment(62bdd930-d981-4fed-ad58-9d410d5c0393),segment_id=62bdd930-d981-4fed-ad58-9d410d5c0393)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:57:51.020081 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': 'ba178573-06ff-41da-95d0-ecc4c7c453b9', 'network_id': '9da693b1-1216-4020-9114-46c9936e8a72', 'port_id': 'ba178573-06ff-41da-95d0-ecc4c7c453b9', 'mac_address': 'fa:16:3e:f4:09:2d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 418, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8265e939-4727-4318-be2f-9d57754a238e', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:57:51.060761 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:51.073941 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ba178573-06ff-41da-95d0-ecc4c7c453b9 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:57:51.092882 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port ba178573-06ff-41da-95d0-ecc4c7c453b9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=ba178573-06ff-41da-95d0-ecc4c7c453b9,segment=NetworkSegment(62bdd930-d981-4fed-ad58-9d410d5c0393),segment_id=62bdd930-d981-4fed-ad58-9d410d5c0393)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:57:51.097001 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:51.143582 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=ba178573-06ff-41da-95d0-ecc4c7c453b9,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:51.156323 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2669040-0203-4966-a5db-95981150307c req-5e600525-2183-4b01-b3d4-f1eeb6ecd0b4 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:51.157827 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c2669040-0203-4966-a5db-95981150307c req-5e600525-2183-4b01-b3d4-f1eeb6ecd0b4 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0481043 Dec 20 05:57:51.204366 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c2669040-0203-4966-a5db-95981150307c req-4d56fca6-72ea-4c59-aa4c-630801adc27d tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401487 Dec 20 05:57:51.500609 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c8f140a-4ead-454c-92c7-0faebadd04c9 req-9a6fa881-0af2-48ba-8158-7bad65739ee9 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:51.501985 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0c8f140a-4ead-454c-92c7-0faebadd04c9 req-9a6fa881-0af2-48ba-8158-7bad65739ee9 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 945 time: 0.0485570 Dec 20 05:57:51.551104 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0c8f140a-4ead-454c-92c7-0faebadd04c9 req-1849f60e-9b87-420c-a6fc-65eee9dd1834 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432661 Dec 20 05:57:51.616969 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['ba178573-06ff-41da-95d0-ecc4c7c453b9'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:57:52.311726 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-507e5f20-aba5-4df0-9627-5cc9843d0e66 req-d74c99f8-48be-42d3-8f09-f22f7c1dd512 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:52.313183 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-507e5f20-aba5-4df0-9627-5cc9843d0e66 req-d74c99f8-48be-42d3-8f09-f22f7c1dd512 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.54 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0491207 Dec 20 05:57:52.315836 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67286d89-a416-4ce5-b81a-f919639274c3 req-1f70ba24-3710-427a-8825-ccd23e302bf5 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:52.317294 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-67286d89-a416-4ce5-b81a-f919639274c3 req-1f70ba24-3710-427a-8825-ccd23e302bf5 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 945 time: 0.0473297 Dec 20 05:57:52.364291 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-67286d89-a416-4ce5-b81a-f919639274c3 req-68e9ac46-6780-46be-8165-f02f3f0d002e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410209 Dec 20 05:57:52.612411 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-507e5f20-aba5-4df0-9627-5cc9843d0e66 req-83217ea6-adc9-4e31-84eb-31e95653e106 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Deleting port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:57:52.612974 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-507e5f20-aba5-4df0-9627-5cc9843d0e66 req-83217ea6-adc9-4e31-84eb-31e95653e106 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:52.674091 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a7eee9-92f6-4f72-8dbc-1b8c5d3ff354 req-e17751dd-9a27-41d8-a9e1-91046f849796 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:52.675577 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-75a7eee9-92f6-4f72-8dbc-1b8c5d3ff354 req-e17751dd-9a27-41d8-a9e1-91046f849796 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 945 time: 0.0516746 Dec 20 05:57:52.704019 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-507e5f20-aba5-4df0-9627-5cc9843d0e66 req-83217ea6-adc9-4e31-84eb-31e95653e106 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] For port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c,segment=NetworkSegment(e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e),segment_id=e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:57:52.704380 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-507e5f20-aba5-4df0-9627-5cc9843d0e66 req-83217ea6-adc9-4e31-84eb-31e95653e106 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:52.715830 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-507e5f20-aba5-4df0-9627-5cc9843d0e66 req-83217ea6-adc9-4e31-84eb-31e95653e106 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Calling delete_port for 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c owned by compute:nova {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:57:52.721004 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-75a7eee9-92f6-4f72-8dbc-1b8c5d3ff354 req-af30e648-b0db-46e7-a20c-40808b0a9346 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389516 Dec 20 05:57:52.837754 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-507e5f20-aba5-4df0-9627-5cc9843d0e66 req-83217ea6-adc9-4e31-84eb-31e95653e106 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:52.867627 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83217ea6-adc9-4e31-84eb-31e95653e106 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Pushing event deleted for resources: {'Port': ['ID=43ed8d1a-ee0a-4df9-9df5-1c14a02f642c,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:52.890171 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['0a3d7cef-eb9c-4b58-965b-9e4878a9fa09', '43ed8d1a-ee0a-4df9-9df5-1c14a02f642c'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:57:52.907056 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-507e5f20-aba5-4df0-9627-5cc9843d0e66 req-83217ea6-adc9-4e31-84eb-31e95653e106 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] No DVR routers for this DVR port 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c on host hv-cinder-82227 {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 05:57:52.909577 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-507e5f20-aba5-4df0-9627-5cc9843d0e66 req-83217ea6-adc9-4e31-84eb-31e95653e106 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:52.913102 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-507e5f20-aba5-4df0-9627-5cc9843d0e66 req-83217ea6-adc9-4e31-84eb-31e95653e106 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.54 "DELETE /v2.0/ports/43ed8d1a-ee0a-4df9-9df5-1c14a02f642c HTTP/1.1" status: 204 len: 173 time: 0.5921814 Dec 20 05:57:52.913529 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3', 'name': 'network-vif-deleted', 'tag': '43ed8d1a-ee0a-4df9-9df5-1c14a02f642c'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:57:52.915777 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-34ef6b00-52b3-4067-9152-4ddc31443e58" -d '{"events": [{"server_uuid": "66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3", "name": "network-vif-deleted", "tag": "43ed8d1a-ee0a-4df9-9df5-1c14a02f642c"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:57:52.933103 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device ba178573-06ff-41da-95d0-ecc4c7c453b9 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:57:52.958659 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:57:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1f2c4488-868f-4911-88b9-7accad0b2585 x-openstack-request-id: req-1f2c4488-868f-4911-88b9-7accad0b2585 {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:57:52.959204 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3", "name": "network-vif-deleted", "tag": "43ed8d1a-ee0a-4df9-9df5-1c14a02f642c", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:57:52.959691 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-1f2c4488-868f-4911-88b9-7accad0b2585 {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:57:52.960585 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3', 'name': 'network-vif-deleted', 'tag': '43ed8d1a-ee0a-4df9-9df5-1c14a02f642c', 'status': 'completed', 'code': 200} Dec 20 05:57:53.151114 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port ba178573-06ff-41da-95d0-ecc4c7c453b9 completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 05:57:53.157783 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port ba178573-06ff-41da-95d0-ecc4c7c453b9 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:57:53.158166 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:53.268917 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:53.290020 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd63d89bf-797a-4e53-b11e-6dd04664529f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ba178573-06ff-41da-95d0-ecc4c7c453b9'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:57:53.292247 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9d983d6d-5458-4c7e-a7f9-f04c77ea7791" -d '{"events": [{"server_uuid": "d63d89bf-797a-4e53-b11e-6dd04664529f", "name": "network-vif-plugged", "status": "completed", "tag": "ba178573-06ff-41da-95d0-ecc4c7c453b9"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:57:53.311405 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port ba178573-06ff-41da-95d0-ecc4c7c453b9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=ba178573-06ff-41da-95d0-ecc4c7c453b9,segment=NetworkSegment(62bdd930-d981-4fed-ad58-9d410d5c0393),segment_id=62bdd930-d981-4fed-ad58-9d410d5c0393)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:57:53.316245 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:57:53.340624 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:57:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-83d311ae-04d6-48f2-a6af-9c4ace5af14a x-openstack-request-id: req-83d311ae-04d6-48f2-a6af-9c4ace5af14a {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:57:53.340914 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d63d89bf-797a-4e53-b11e-6dd04664529f", "name": "network-vif-plugged", "status": "completed", "tag": "ba178573-06ff-41da-95d0-ecc4c7c453b9", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:57:53.341169 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-83d311ae-04d6-48f2-a6af-9c4ace5af14a {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:57:53.341743 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd63d89bf-797a-4e53-b11e-6dd04664529f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ba178573-06ff-41da-95d0-ecc4c7c453b9', 'code': 200} Dec 20 05:57:53.366216 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=ba178573-06ff-41da-95d0-ecc4c7c453b9,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:57:53.479303 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-386954c7-ba28-455e-a578-33e84206e190 req-fb8b34d5-0ebf-41a8-9aa6-f16fc498892e tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=66eb9b3a-5a19-4a6c-bb6b-a71961eee4c3 HTTP/1.1" status: 200 len: 210 time: 0.0318847 Dec 20 05:57:53.590081 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788daf0a-8d37-4ee6-828e-069ba8ec6fa5 req-86a43834-6c58-4fd8-97a1-a001f12c97ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:53.591616 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-788daf0a-8d37-4ee6-828e-069ba8ec6fa5 req-86a43834-6c58-4fd8-97a1-a001f12c97ac service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 1099 time: 0.0388258 Dec 20 05:57:53.641206 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-788daf0a-8d37-4ee6-828e-069ba8ec6fa5 req-93a6076b-80b8-4d5f-9887-b5c69955efa9 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378606 Dec 20 05:57:53.833776 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a39d69bf-f368-4182-883e-af85dac21018 req-4183cc78-1f73-4658-b65e-81ba2b9428c4 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:53.835223 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a39d69bf-f368-4182-883e-af85dac21018 req-4183cc78-1f73-4658-b65e-81ba2b9428c4 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 946 time: 0.0483019 Dec 20 05:57:53.880503 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a39d69bf-f368-4182-883e-af85dac21018 req-48bf32f3-531d-460f-a5c5-cd94de0d288a tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394309 Dec 20 05:57:54.736179 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9752f6f2-8a82-4fe8-a399-ea11c9fe92bf req-ee60ab0b-3344-411e-be69-2e13065131d3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:54.737644 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9752f6f2-8a82-4fe8-a399-ea11c9fe92bf req-ee60ab0b-3344-411e-be69-2e13065131d3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0485015 Dec 20 05:57:54.783907 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9752f6f2-8a82-4fe8-a399-ea11c9fe92bf req-ec18dc68-2e9d-4f8a-9d73-725edd860b7f tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398660 Dec 20 05:57:54.922394 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:57:54.942571 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:57:54.942916 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 43ed8d1a-ee0a-4df9-9df5-1c14a02f642c not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:57:54.998630 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-081f25f8-e1b1-4c89-b34a-44d35528d2c9 req-9622ba97-4df3-4b76-9adc-43491df9bc50 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:55.000131 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-081f25f8-e1b1-4c89-b34a-44d35528d2c9 req-9622ba97-4df3-4b76-9adc-43491df9bc50 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 946 time: 0.0508428 Dec 20 05:57:55.046454 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-081f25f8-e1b1-4c89-b34a-44d35528d2c9 req-ebd14e4e-4a73-4368-b4aa-0264c4b412e8 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403817 Dec 20 05:57:55.896978 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50dcc5b-1015-42c3-a272-0f8d8ef09bad req-7f998361-f003-40f4-a6b9-f0aa59f1d560 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:55.898420 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d50dcc5b-1015-42c3-a272-0f8d8ef09bad req-7f998361-f003-40f4-a6b9-f0aa59f1d560 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0466039 Dec 20 05:57:55.944487 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d50dcc5b-1015-42c3-a272-0f8d8ef09bad req-9cae9d10-f679-48c5-8d3c-de2e1912641c tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395041 Dec 20 05:57:56.166517 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76137e01-55db-4c40-a57f-83ff34f67864 req-fe832052-5d40-4ae8-8792-dc82c9141c1a tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:56.167993 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-76137e01-55db-4c40-a57f-83ff34f67864 req-fe832052-5d40-4ae8-8792-dc82c9141c1a tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 946 time: 0.0528162 Dec 20 05:57:56.213792 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-76137e01-55db-4c40-a57f-83ff34f67864 req-f68bc882-498c-440d-b278-ced0c9761a8d tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399697 Dec 20 05:57:57.057979 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-605f89ec-0f4e-4b7a-a854-9cf12a9cebc8 req-bbb231ea-b60c-4427-b413-aa5cef544709 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:57.059348 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-605f89ec-0f4e-4b7a-a854-9cf12a9cebc8 req-bbb231ea-b60c-4427-b413-aa5cef544709 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0489342 Dec 20 05:57:57.105643 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-605f89ec-0f4e-4b7a-a854-9cf12a9cebc8 req-fdb9c066-3c81-4cb4-85e5-23e80856dec0 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404110 Dec 20 05:57:58.219541 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-713e91e1-d234-4b1a-9bf3-9c25433209a0 req-a89a5349-a90f-4c7d-8dcc-057e844dd708 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:58.220998 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-713e91e1-d234-4b1a-9bf3-9c25433209a0 req-a89a5349-a90f-4c7d-8dcc-057e844dd708 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0479207 Dec 20 05:57:58.270595 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-713e91e1-d234-4b1a-9bf3-9c25433209a0 req-97393187-d4fa-4303-a0bd-ff247ca9f679 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438056 Dec 20 05:57:59.387015 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1707fa86-389d-4e8a-8f7a-87398ab8d537 req-8d0146de-84c4-4dc9-9bbb-5d6f1975c2ae tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:57:59.388524 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1707fa86-389d-4e8a-8f7a-87398ab8d537 req-8d0146de-84c4-4dc9-9bbb-5d6f1975c2ae tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0525236 Dec 20 05:57:59.434709 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1707fa86-389d-4e8a-8f7a-87398ab8d537 req-d6f16fb7-08d1-49a1-8bdf-08603e60e2f3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402451 Dec 20 05:58:00.549252 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790e22d7-1a14-42a4-bec1-c033a9ee90de req-39fcb8f4-73db-4f1b-bd03-6759f0dd35c6 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:00.550699 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-790e22d7-1a14-42a4-bec1-c033a9ee90de req-39fcb8f4-73db-4f1b-bd03-6759f0dd35c6 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0488279 Dec 20 05:58:00.598496 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-790e22d7-1a14-42a4-bec1-c033a9ee90de req-441cde1d-36a9-4194-a76b-804984d28a87 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413988 Dec 20 05:58:01.712440 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-52c12ae0-40be-4d91-a723-dc8c37f60262 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:01.714560 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26f85b77-03ed-4dbc-957e-1c06894caeac req-d2aa7f84-5be7-4a6d-b752-ae4a2edb0dde tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:01.716063 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-26f85b77-03ed-4dbc-957e-1c06894caeac req-d2aa7f84-5be7-4a6d-b752-ae4a2edb0dde tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0507286 Dec 20 05:58:01.762532 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-26f85b77-03ed-4dbc-957e-1c06894caeac req-a1108a4c-74c4-49e8-b06b-331e347715eb tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406089 Dec 20 05:58:02.874370 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a810415a-12d2-40e8-a9bb-96b748b3e20e req-7d788d64-1204-42dd-9e86-c719b299aac2 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:02.875941 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a810415a-12d2-40e8-a9bb-96b748b3e20e req-7d788d64-1204-42dd-9e86-c719b299aac2 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0483637 Dec 20 05:58:02.921306 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a810415a-12d2-40e8-a9bb-96b748b3e20e req-4906127b-0120-4618-aefb-7b9932758ac7 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/security-groups?id=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396461 Dec 20 05:58:03.081979 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ff31b7-1bc4-489f-967f-a16bbaeec6cc req-551f0c7a-e119-4aaa-8e3f-5ede6ff50f97 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:03.082892 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-a1ff31b7-1bc4-489f-967f-a16bbaeec6cc req-551f0c7a-e119-4aaa-8e3f-5ede6ff50f97 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.54 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 945 time: 0.0514109 Dec 20 05:58:03.173923 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-a1ff31b7-1bc4-489f-967f-a16bbaeec6cc req-15af2122-3f2e-4b5f-99e5-e9380d77cbb3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Deleting port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:58:03.174261 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-a1ff31b7-1bc4-489f-967f-a16bbaeec6cc req-15af2122-3f2e-4b5f-99e5-e9380d77cbb3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:03.266090 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-a1ff31b7-1bc4-489f-967f-a16bbaeec6cc req-15af2122-3f2e-4b5f-99e5-e9380d77cbb3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] For port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09,segment=NetworkSegment(e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e),segment_id=e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:03.266457 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-a1ff31b7-1bc4-489f-967f-a16bbaeec6cc req-15af2122-3f2e-4b5f-99e5-e9380d77cbb3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:03.278915 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-a1ff31b7-1bc4-489f-967f-a16bbaeec6cc req-15af2122-3f2e-4b5f-99e5-e9380d77cbb3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Calling delete_port for 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 owned by compute:nova {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:58:03.432352 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-a1ff31b7-1bc4-489f-967f-a16bbaeec6cc req-15af2122-3f2e-4b5f-99e5-e9380d77cbb3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:03.466388 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15af2122-3f2e-4b5f-99e5-e9380d77cbb3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Pushing event deleted for resources: {'Port': ['ID=0a3d7cef-eb9c-4b58-965b-9e4878a9fa09,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:03.481118 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['0a3d7cef-eb9c-4b58-965b-9e4878a9fa09'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:58:03.507279 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-a1ff31b7-1bc4-489f-967f-a16bbaeec6cc req-15af2122-3f2e-4b5f-99e5-e9380d77cbb3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] No DVR routers for this DVR port 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 on host hv-cinder-82227 {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 05:58:03.510526 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-a1ff31b7-1bc4-489f-967f-a16bbaeec6cc req-15af2122-3f2e-4b5f-99e5-e9380d77cbb3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:03.514111 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-a1ff31b7-1bc4-489f-967f-a16bbaeec6cc req-15af2122-3f2e-4b5f-99e5-e9380d77cbb3 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.54 "DELETE /v2.0/ports/0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 HTTP/1.1" status: 204 len: 173 time: 0.4233580 Dec 20 05:58:03.514572 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3651bc83-8bde-4d1f-9102-e33780b728cd', 'name': 'network-vif-deleted', 'tag': '0a3d7cef-eb9c-4b58-965b-9e4878a9fa09'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:58:03.517458 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fd2cb0ec-6aaa-4ce4-a07f-fed664ffeb3b" -d '{"events": [{"server_uuid": "3651bc83-8bde-4d1f-9102-e33780b728cd", "name": "network-vif-deleted", "tag": "0a3d7cef-eb9c-4b58-965b-9e4878a9fa09"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:58:03.551838 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a6ab417-df9e-4ada-9857-943a02089468 req-66928d25-177d-425f-8ef0-cbd480f1daa2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:03.553391 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1a6ab417-df9e-4ada-9857-943a02089468 req-66928d25-177d-425f-8ef0-cbd480f1daa2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0498238 Dec 20 05:58:03.557143 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:58:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b8c32436-333f-44f0-9697-33d4365c1670 x-openstack-request-id: req-b8c32436-333f-44f0-9697-33d4365c1670 {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:58:03.557661 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3651bc83-8bde-4d1f-9102-e33780b728cd", "name": "network-vif-deleted", "tag": "0a3d7cef-eb9c-4b58-965b-9e4878a9fa09", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:58:03.557915 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-b8c32436-333f-44f0-9697-33d4365c1670 {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:58:03.558736 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3651bc83-8bde-4d1f-9102-e33780b728cd', 'name': 'network-vif-deleted', 'tag': '0a3d7cef-eb9c-4b58-965b-9e4878a9fa09', 'status': 'completed', 'code': 200} Dec 20 05:58:03.604515 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1a6ab417-df9e-4ada-9857-943a02089468 req-3d6ef01e-0a91-489e-885a-54a5e31921d9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435803 Dec 20 05:58:04.029696 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9323fe51-7ec2-45b8-9fa8-4754443f1997 req-9d03004d-262f-41b3-9fb5-3f973f386890 tempest-ServerRescueNegativeTestJSON-1067968603 tempest-ServerRescueNegativeTestJSON-1067968603-project] 10.222.0.46 "GET /v2.0/ports?device_id=3651bc83-8bde-4d1f-9102-e33780b728cd HTTP/1.1" status: 200 len: 210 time: 0.0260346 Dec 20 05:58:04.150378 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-58df6cd8-5534-4479-98e3-08544a8e9e2c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:04.719463 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-258a9993-f358-4700-97a4-357335e9a520 req-61682923-53d2-4ec4-8ae5-b5e3b93620b7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:04.720920 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-258a9993-f358-4700-97a4-357335e9a520 req-61682923-53d2-4ec4-8ae5-b5e3b93620b7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0482817 Dec 20 05:58:04.765438 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-258a9993-f358-4700-97a4-357335e9a520 req-d851e83c-540b-4643-af80-7d858d8eb6bc tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0387154 Dec 20 05:58:04.985804 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:05.085286 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47728) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:05.483457 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-90533e4c-39fa-413f-8339-91f74c55cb6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1697024'] for router_interface, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:05.760428 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-90533e4c-39fa-413f-8339-91f74c55cb6c admin admin] Deleting port e33a1ab9-8ab9-480c-bbce-99e76e107aac {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:58:05.760672 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-90533e4c-39fa-413f-8339-91f74c55cb6c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:05.835523 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-90533e4c-39fa-413f-8339-91f74c55cb6c admin admin] For port e33a1ab9-8ab9-480c-bbce-99e76e107aac, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=e33a1ab9-8ab9-480c-bbce-99e76e107aac,segment=NetworkSegment(e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e),segment_id=e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:05.835932 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-90533e4c-39fa-413f-8339-91f74c55cb6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:05.848295 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-90533e4c-39fa-413f-8339-91f74c55cb6c admin admin] Calling delete_port for e33a1ab9-8ab9-480c-bbce-99e76e107aac owned by network:router_interface {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:58:05.882142 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bc87c3c-9013-4b4a-bc6d-10a9e244d0d1 req-1e80af20-0d97-4096-bda9-16e028470036 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:05.884312 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5bc87c3c-9013-4b4a-bc6d-10a9e244d0d1 req-1e80af20-0d97-4096-bda9-16e028470036 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0488746 Dec 20 05:58:05.933489 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5bc87c3c-9013-4b4a-bc6d-10a9e244d0d1 req-65afcd35-a14a-4a4a-b717-2c7e8547a578 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433686 Dec 20 05:58:06.024870 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-90533e4c-39fa-413f-8339-91f74c55cb6c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:06.052203 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90533e4c-39fa-413f-8339-91f74c55cb6c admin admin] Pushing event deleted for resources: {'Port': ['ID=e33a1ab9-8ab9-480c-bbce-99e76e107aac,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:06.209675 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-90533e4c-39fa-413f-8339-91f74c55cb6c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1617481', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1697260'] for router_interface, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:06.421023 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-90533e4c-39fa-413f-8339-91f74c55cb6c admin admin] Router 78306cdd-08fd-430b-bc23-bf16053632cc has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:58:06.475092 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:06.734419 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-90533e4c-39fa-413f-8339-91f74c55cb6c admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:58:06.739330 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-90533e4c-39fa-413f-8339-91f74c55cb6c admin admin] 10.222.0.46 "PUT /v2.0/routers/78306cdd-08fd-430b-bc23-bf16053632cc/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6524425 Dec 20 05:58:06.741840 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47734) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:06.744591 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2a579ad-9e39-4782-8e35-4f928f6192e8 None None] Sync routers for ids ['78306cdd-08fd-430b-bc23-bf16053632cc'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:58:06.754706 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2a579ad-9e39-4782-8e35-4f928f6192e8 None None] Routers {'78306cdd-08fd-430b-bc23-bf16053632cc'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:06.755365 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-f2a579ad-9e39-4782-8e35-4f928f6192e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['78306cdd-08fd-430b-bc23-bf16053632cc'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:06.843672 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] Publish callbacks [] for router, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:06.858428 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-f2a579ad-9e39-4782-8e35-4f928f6192e8 None None] Set router 78306cdd-08fd-430b-bc23-bf16053632cc gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:06.945097 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.003618 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] Deleting port 45f06a12-9255-46cd-92b8-3cb459fa9843 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:58:07.003889 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.042110 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-f2a579ad-9e39-4782-8e35-4f928f6192e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'name': 'tempest-ServerRescueNegativeTestJSON-1549376031-router', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.211'}], 'enable_snat': True}, 'gw_port_id': '45f06a12-9255-46cd-92b8-3cb459fa9843', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:58:05Z', 'revision_number': 5, 'project_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'gw_port': {'id': '45f06a12-9255-46cd-92b8-3cb459fa9843', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:72:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:54:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:07.050951 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045fea94-bea3-4782-b186-a9118da92ae4 req-006cc0a0-8eb7-4273-953c-285132611350 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:07.052540 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-045fea94-bea3-4782-b186-a9118da92ae4 req-006cc0a0-8eb7-4273-953c-285132611350 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0495658 Dec 20 05:58:07.067843 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2a579ad-9e39-4782-8e35-4f928f6192e8 None None] Checking router: 78306cdd-08fd-430b-bc23-bf16053632cc for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:58:07.078286 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2a579ad-9e39-4782-8e35-4f928f6192e8 None None] Routers {'78306cdd-08fd-430b-bc23-bf16053632cc'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:07.079154 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-f2a579ad-9e39-4782-8e35-4f928f6192e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['78306cdd-08fd-430b-bc23-bf16053632cc'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:07.090988 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] For port 45f06a12-9255-46cd-92b8-3cb459fa9843, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=45f06a12-9255-46cd-92b8-3cb459fa9843,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:07.091374 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.103901 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-045fea94-bea3-4782-b186-a9118da92ae4 req-d7ed9bbc-f4bf-4d7c-943b-c1960f01274b tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445406 Dec 20 05:58:07.104516 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] Calling delete_port for 45f06a12-9255-46cd-92b8-3cb459fa9843 owned by network:router_gateway {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:58:07.177642 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-f2a579ad-9e39-4782-8e35-4f928f6192e8 None None] Set router 78306cdd-08fd-430b-bc23-bf16053632cc gateway port host: None {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:07.231068 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-f2a579ad-9e39-4782-8e35-4f928f6192e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'name': 'tempest-ServerRescueNegativeTestJSON-1549376031-router', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:58:06Z', 'revision_number': 6, 'project_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'gw_port_host': None}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:07.256697 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2a579ad-9e39-4782-8e35-4f928f6192e8 None None] The sync data for ids ['78306cdd-08fd-430b-bc23-bf16053632cc'] in dv-cinder-822278-1-iscsi is: [{'id': '78306cdd-08fd-430b-bc23-bf16053632cc', 'name': 'tempest-ServerRescueNegativeTestJSON-1549376031-router', 'tenant_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:54:52Z', 'updated_at': '2021-12-20T05:58:06Z', 'revision_number': 6, 'project_id': 'a2e9de0d64e642f08bf90d402e77baa3', 'gw_port_host': None}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:58:07.270378 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.305100 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] Pushing event deleted for resources: {'Port': ['ID=45f06a12-9255-46cd-92b8-3cb459fa9843,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:07.360552 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1703502'] for router_gateway, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.385130 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:58:07.406641 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:58:07.407041 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 0a3d7cef-eb9c-4b58-965b-9e4878a9fa09 not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:58:07.469265 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1698526', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25973'] for router, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.471352 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.538072 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1698533'] for router, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.538599 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 78306cdd-08fd-430b-bc23-bf16053632cc {{(pid=102446) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 20 05:58:07.544089 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] Publish callbacks [] for router, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.545209 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-b6fd56a8-8323-49c5-82ad-162c071da3a6 admin admin] 10.222.0.46 "DELETE /v2.0/routers/78306cdd-08fd-430b-bc23-bf16053632cc HTTP/1.1" status: 204 len: 168 time: 0.8019760 Dec 20 05:58:07.547838 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47740) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:07.575405 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.607974 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_v2 [None req-4fe98d6a-c187-4d32-8c98-260da39ee8b8 admin admin] Deleting subnet e1658c3d-4c2e-4687-a529-637456d3a81c {{(pid=102446) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 05:58:07.611148 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4fe98d6a-c187-4d32-8c98-260da39ee8b8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.647808 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4fe98d6a-c187-4d32-8c98-260da39ee8b8 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8976279'] for subnet, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.688744 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4fe98d6a-c187-4d32-8c98-260da39ee8b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.748465 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4fe98d6a-c187-4d32-8c98-260da39ee8b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9173344', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3270978'] for subnet, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.779756 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fe98d6a-c187-4d32-8c98-260da39ee8b8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e1658c3d-4c2e-4687-a529-637456d3a81c,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:07.781713 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4fe98d6a-c187-4d32-8c98-260da39ee8b8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.784937 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-4fe98d6a-c187-4d32-8c98-260da39ee8b8 admin admin] 10.222.0.46 "DELETE /v2.0/subnets/e1658c3d-4c2e-4687-a529-637456d3a81c HTTP/1.1" status: 204 len: 168 time: 0.2361681 Dec 20 05:58:07.787401 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47742) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:07.854163 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-798691ac-7ddf-4c10-86cb-16e23bbe683b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.956381 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-798691ac-7ddf-4c10-86cb-16e23bbe683b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:07.980487 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-798691ac-7ddf-4c10-86cb-16e23bbe683b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a']}} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:07.989247 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-e6e5b02a-2355-4a24-82fa-141c69be2c86 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:07.990687 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-e6e5b02a-2355-4a24-82fa-141c69be2c86 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.54 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0985894 Dec 20 05:58:08.004892 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-798691ac-7ddf-4c10-86cb-16e23bbe683b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e') {'for_net_delete': True} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:08.005184 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-798691ac-7ddf-4c10-86cb-16e23bbe683b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e40b2d1c-c486-4fa0-bf0f-300b2e2b4b0e') {} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:08.042469 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-798691ac-7ddf-4c10-86cb-16e23bbe683b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8976286'] for segment, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.068797 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-798691ac-7ddf-4c10-86cb-16e23bbe683b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.079151 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 45f06a12-9255-46cd-92b8-3cb459fa9843 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:58:08.094214 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-798691ac-7ddf-4c10-86cb-16e23bbe683b admin admin] Releasing vlan 446 on physical network physnet1 to pool {{(pid=102446) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 05:58:08.094617 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-798691ac-7ddf-4c10-86cb-16e23bbe683b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9173254'] for segment, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.102925 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 45f06a12-9255-46cd-92b8-3cb459fa9843 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:58:08.103382 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 45f06a12-9255-46cd-92b8-3cb459fa9843 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:58:08.103924 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device e33a1ab9-8ab9-480c-bbce-99e76e107aac no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: Traceback (most recent call last): Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: timer() Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: cb(*args, **kw) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: return func(*args, **kwargs) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: self._notify() Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: self.callback(batched_events) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: event.method(event) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: return f(self, *a, **k) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._get(url).json() Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: return self.request(url, 'GET', **kwargs) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 05:58:08.105915 dv-cinder-822278-1-iscsi neutron-server[102446]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 05:58:08.122572 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: e33a1ab9-8ab9-480c-bbce-99e76e107aac {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:58:08.122919 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device e33a1ab9-8ab9-480c-bbce-99e76e107aac not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:58:08.158828 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-798691ac-7ddf-4c10-86cb-16e23bbe683b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.167792 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-798691ac-7ddf-4c10-86cb-16e23bbe683b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.173575 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-798691ac-7ddf-4c10-86cb-16e23bbe683b admin admin] 10.222.0.46 "DELETE /v2.0/networks/d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a HTTP/1.1" status: 204 len: 168 time: 0.3818064 Dec 20 05:58:08.189125 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-798691ac-7ddf-4c10-86cb-16e23bbe683b admin admin] Pushing event deleted for resources: {'Network': ['ID=d3f6e1ed-09e8-42e4-9c32-0efbc8cd603a,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:08.200308 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Deleting port abed4d23-da46-4f59-9f36-c9fc12fcb192 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:58:08.200655 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.261073 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54534103-4d7b-42a0-810c-4117df0155a6 req-024b9107-9a63-4278-aa4e-ecb52869fb4e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:08.272389 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-54534103-4d7b-42a0-810c-4117df0155a6 req-024b9107-9a63-4278-aa4e-ecb52869fb4e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 945 time: 0.0790875 Dec 20 05:58:08.311613 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] For port abed4d23-da46-4f59-9f36-c9fc12fcb192, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=abed4d23-da46-4f59-9f36-c9fc12fcb192,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:08.312105 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.337041 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-54534103-4d7b-42a0-810c-4117df0155a6 req-aeb4e806-134f-4900-a7e7-43d1afc631cb tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=38e9df07-f897-436d-ac60-fe287113cf14&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0634003 Dec 20 05:58:08.472952 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 47754) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:08.516268 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-f38b45e0-098c-46fa-8b38-e2857206db04 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=a2e9de0d64e642f08bf90d402e77baa3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0421710 Dec 20 05:58:08.518640 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 47756) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:08.565604 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.587412 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.633267 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.634276 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.634659 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.635031 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.l3_db [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Floating IP d1719efe-7c3d-4c2b-8a5a-91c7554f551c disassociated. External IP: 172.27.3.226, port: abed4d23-da46-4f59-9f36-c9fc12fcb192. Dec 20 05:58:08.635373 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Calling delete_port for abed4d23-da46-4f59-9f36-c9fc12fcb192 owned by compute:nova {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:58:08.636130 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.637306 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6 HTTP/1.1" status: 204 len: 168 time: 0.1177826 Dec 20 05:58:08.645871 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e3f13ee6-cd4a-4f76-b68f-d32ddc67a1a6,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:08.653928 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:08.654306 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:08.654613 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:08.654948 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:08.655283 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:08.655697 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:08.656028 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:08.656358 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:08.656686 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:08.657013 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:08.657335 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:08.657652 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:08.657973 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf7e9be4-919b-4ad2-9884-9cc58e43fb05 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:08.686274 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.776150 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:08.803688 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event deleted for resources: {'Port': ['ID=abed4d23-da46-4f59-9f36-c9fc12fcb192,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:08.917808 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Router 3f858ad2-b10f-4f04-9727-f99638a01796 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:58:09.029929 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:58:09.041702 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad04fd28-40c7-4a69-b92b-eea2c5b3e2e5 None None] Sync routers for ids ['3f858ad2-b10f-4f04-9727-f99638a01796'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:58:09.052434 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad04fd28-40c7-4a69-b92b-eea2c5b3e2e5 None None] Routers {'3f858ad2-b10f-4f04-9727-f99638a01796'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:09.053076 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-ad04fd28-40c7-4a69-b92b-eea2c5b3e2e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['3f858ad2-b10f-4f04-9727-f99638a01796'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:09.074094 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] No DVR routers for this DVR port abed4d23-da46-4f59-9f36-c9fc12fcb192 on host hv-cinder-82227 {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 05:58:09.077019 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:09.081131 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-98dd689e-08cb-486d-812f-5031a9e30bf7 req-6e882f05-a926-481b-bd6b-127d1f399d4c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.54 "DELETE /v2.0/ports/abed4d23-da46-4f59-9f36-c9fc12fcb192 HTTP/1.1" status: 204 len: 173 time: 1.0832036 Dec 20 05:58:09.081686 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e81aeaf1-e5dc-482f-b37d-b91f972dc6ff', 'name': 'network-vif-deleted', 'tag': 'abed4d23-da46-4f59-9f36-c9fc12fcb192'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:58:09.084731 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5c4bb06f-bb61-46bb-83e9-4adee68372e3" -d '{"events": [{"server_uuid": "e81aeaf1-e5dc-482f-b37d-b91f972dc6ff", "name": "network-vif-deleted", "tag": "abed4d23-da46-4f59-9f36-c9fc12fcb192"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:58:09.126716 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:58:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6b699005-9bd3-4d1a-8ab1-d945012f4705 x-openstack-request-id: req-6b699005-9bd3-4d1a-8ab1-d945012f4705 {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:58:09.127223 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e81aeaf1-e5dc-482f-b37d-b91f972dc6ff", "name": "network-vif-deleted", "tag": "abed4d23-da46-4f59-9f36-c9fc12fcb192", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:58:09.127757 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-6b699005-9bd3-4d1a-8ab1-d945012f4705 {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:58:09.128325 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e81aeaf1-e5dc-482f-b37d-b91f972dc6ff', 'name': 'network-vif-deleted', 'tag': 'abed4d23-da46-4f59-9f36-c9fc12fcb192', 'status': 'completed', 'code': 200} Dec 20 05:58:09.167808 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-ad04fd28-40c7-4a69-b92b-eea2c5b3e2e5 None None] Set router 3f858ad2-b10f-4f04-9727-f99638a01796 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:09.397735 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-ad04fd28-40c7-4a69-b92b-eea2c5b3e2e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:35Z', 'revision_number': 5, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:09.408954 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 47782) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:09.430298 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad04fd28-40c7-4a69-b92b-eea2c5b3e2e5 None None] Checking router: 3f858ad2-b10f-4f04-9727-f99638a01796 for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:58:09.439365 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad04fd28-40c7-4a69-b92b-eea2c5b3e2e5 None None] Routers {'3f858ad2-b10f-4f04-9727-f99638a01796'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:09.440012 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-ad04fd28-40c7-4a69-b92b-eea2c5b3e2e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['3f858ad2-b10f-4f04-9727-f99638a01796'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:09.456513 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-722e6d32-7a5a-43e4-a428-fcce11986871 req-d4ab5d60-50a6-4ac2-bb17-a98a4f016b15 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 210 time: 0.0291002 Dec 20 05:58:09.527736 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-915509005-network', 'tenant_id': '60c21858b1c7408daa963605a7c691c0'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:09.551411 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-ad04fd28-40c7-4a69-b92b-eea2c5b3e2e5 None None] Set router 3f858ad2-b10f-4f04-9727-f99638a01796 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:09.553952 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] Made reservation on behalf of 60c21858b1c7408daa963605a7c691c0 for: {'network': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:58:09.556752 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:09.565402 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:09.650226 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:09.654012 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:09.680351 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] vlan segment allocate from pool success with {'vlan_id': 414, 'physical_network': 'physnet1'} {{(pid=102445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:58:09.689406 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd93ba0b-00c3-4528-bc0e-354d7e00ef52,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:09.705093 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:09.705430 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.segments_db [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] Added segment c44c7219-40a7-4f55-8e90-10f68acf14be of type vlan for network 6623d855-6648-40fd-8a49-9c323edbff11 Dec 20 05:58:09.746770 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:09.770854 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:09.771861 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:09.772450 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:09.784406 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-ad04fd28-40c7-4a69-b92b-eea2c5b3e2e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:35Z', 'revision_number': 5, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:09.807448 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.3968081 Dec 20 05:58:09.810366 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47788) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:09.816728 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-a26618b7-e175-4e5e-bf20-21448556d902 admin admin] Request body: {'subnet': {'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-subnet', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:09.829206 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad04fd28-40c7-4a69-b92b-eea2c5b3e2e5 None None] The sync data for ids ['3f858ad2-b10f-4f04-9727-f99638a01796'] in dv-cinder-822278-1-iscsi is: [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:35Z', 'revision_number': 5, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:58:09.834870 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efb3dba0-3912-4b41-9a37-3b5a7761afa0 admin admin] Pushing event updated for resources: {'Network': ['ID=6623d855-6648-40fd-8a49-9c323edbff11,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:09.857902 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a26618b7-e175-4e5e-bf20-21448556d902 admin admin] Made reservation on behalf of 60c21858b1c7408daa963605a7c691c0 for: {'subnet': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:58:09.859369 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network 6623d855-6648-40fd-8a49-9c323edbff11 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:58:09.861202 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a26618b7-e175-4e5e-bf20-21448556d902 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3270951'] for subnet, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.046811 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a26618b7-e175-4e5e-bf20-21448556d902 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9168037', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3270985'] for subnet, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.100475 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a26618b7-e175-4e5e-bf20-21448556d902 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4b218758-bd28-403f-ac97-d980db9b78c8,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:10.118142 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a26618b7-e175-4e5e-bf20-21448556d902 admin admin] Checking segment: {'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:58:10.118611 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a26618b7-e175-4e5e-bf20-21448556d902 admin admin] Network hostable DHCP agents. Network: 6623d855-6648-40fd-8a49-9c323edbff11, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102446) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:58:10.136360 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a26618b7-e175-4e5e-bf20-21448556d902 admin admin] Network 6623d855-6648-40fd-8a49-9c323edbff11 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102446) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:58:10.145187 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-a26618b7-e175-4e5e-bf20-21448556d902 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, 6623d855-6648-40fd-8a49-9c323edbff11) {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:10.150063 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a26618b7-e175-4e5e-bf20-21448556d902 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:10.150652 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a26618b7-e175-4e5e-bf20-21448556d902 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.157009 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca41ed5e-fcb2-4258-a1ad-d01faf1b7246 None None] Network 6623d855-6648-40fd-8a49-9c323edbff11 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:58:10.160077 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7be63cc6-a6e6-4632-abcd-959df27fbc62 None None] New status for floating IP d1719efe-7c3d-4c2b-8a5a-91c7554f551c: DOWN {{(pid=102448) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 05:58:10.176935 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-a26618b7-e175-4e5e-bf20-21448556d902 admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.3645649 Dec 20 05:58:10.178990 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47790) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:10.184933 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:10.210068 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1698740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25959'] for router, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.211997 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1698340', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1703163', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1634740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25982'] for router, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.270627 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf82c7edd-7168-52b9-b9ff-dee431eec71c-6623d855-6648-40fd-8a49-9c323edbff11', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'project_id': '60c21858b1c7408daa963605a7c691c0', 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8'}]}} from dv-cinder-822278-1-iscsi. {{(pid=102447) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 20 05:58:10.271789 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.277662 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.421450 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.db_base_plugin_common [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Allocated IP 172.20.0.2 (6623d855-6648-40fd-8a49-9c323edbff11/4b218758-bd28-403f-ac97-d980db9b78c8/a8c210f0-0302-4306-949e-a42cbb928e73) {{(pid=102447) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:58:10.444270 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.607584 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-52243629-4ec0-4745-adb5-20b44b12a8b5 req-bdd57d88-5e08-4ebb-8447-a99e6d41aaf9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 210 time: 0.0355432 Dec 20 05:58:10.631054 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Publish callbacks [] for port, precommit_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.638781 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.680999 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Network 6623d855-6648-40fd-8a49-9c323edbff11 is already hosted by enough agents. {{(pid=102447) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:10.683804 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.base_scheduler [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Resources bound (agent type, host, resource id): {{(pid=102447) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:10.687197 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Received port after_create {{(pid=102447) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:58:10.692363 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Pushing event updated for resources: {'Port': ['ID=a8c210f0-0302-4306-949e-a42cbb928e73,revision_number=1']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:10.703130 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.725573 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.746149 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Attempting to bind port a8c210f0-0302-4306-949e-a42cbb928e73 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:58:10.746519 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Attempting to bind port a8c210f0-0302-4306-949e-a42cbb928e73 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:58:10.746952 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Attempting to bind port a8c210f0-0302-4306-949e-a42cbb928e73 on network 6623d855-6648-40fd-8a49-9c323edbff11 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:58:10.752053 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 58, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:58:10.752419 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Checking segment: {'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:58:10.752810 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.753194 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Bound using segment: {'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:58:10.753783 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Bound port: a8c210f0-0302-4306-949e-a42cbb928e73, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:58:10.754161 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.819025 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] For port a8c210f0-0302-4306-949e-a42cbb928e73, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:58:10.822772 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] For port a8c210f0-0302-4306-949e-a42cbb928e73, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=a8c210f0-0302-4306-949e-a42cbb928e73,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:58:10.828274 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:10.830819 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Allocated IP 172.27.3.84 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/226ec1ab-63e5-4186-886b-18e890bcbd84) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:58:10.887078 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dd4ee81-0594-42a5-9e18-f6675be25bdb None None] Pushing event updated for resources: {'Port': ['ID=a8c210f0-0302-4306-949e-a42cbb928e73,revision_number=2']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:10.949663 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:11.218165 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:11.258687 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:11.261503 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:11.263962 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:58:11.286326 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Pushing event updated for resources: {'Port': ['ID=226ec1ab-63e5-4186-886b-18e890bcbd84,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:11.532278 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:11.734793 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7230f37d-bf80-4455-b518-a6884f500f0e req-49b67360-9043-4e74-ba23-bc4ad1e56ed9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=e81aeaf1-e5dc-482f-b37d-b91f972dc6ff HTTP/1.1" status: 200 len: 210 time: 0.0309942 Dec 20 05:58:11.765263 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1698355', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1703078'] for router, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:11.840607 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11d49192-2a4d-4923-81c9-90cebef59f0b None None] Network 6623d855-6648-40fd-8a49-9c323edbff11 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:58:11.898697 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Router c3741b68-c75b-409c-9c20-6d6808f6e838 is scheduled to L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d with binding_index 1 {{(pid=102446) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 20 05:58:11.962008 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-ebdc0094-2623-47fa-9916-d0965dfadb7a None None] Provisioning complete for port a8c210f0-0302-4306-949e-a42cbb928e73 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:11.962490 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ebdc0094-2623-47fa-9916-d0965dfadb7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:11.984732 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device a8c210f0-0302-4306-949e-a42cbb928e73 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:12.024092 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:58:12.040259 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Sync routers for ids ['c3741b68-c75b-409c-9c20-6d6808f6e838'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:58:12.044701 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] Publish callbacks [] for router, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:12.045962 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-9bae311e-483e-4b28-890c-e1c5172bf2a5 admin admin] 10.222.0.46 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 1.8652258 Dec 20 05:58:12.048721 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47802) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:12.091781 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Routers {'c3741b68-c75b-409c-9c20-6d6808f6e838'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:12.092967 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['c3741b68-c75b-409c-9c20-6d6808f6e838'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:12.305123 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port a8c210f0-0302-4306-949e-a42cbb928e73 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:12.305494 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:12.367952 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ebdc0094-2623-47fa-9916-d0965dfadb7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:12.409689 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Set router c3741b68-c75b-409c-9c20-6d6808f6e838 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:12.479631 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-ebdc0094-2623-47fa-9916-d0965dfadb7a None None] For port a8c210f0-0302-4306-949e-a42cbb928e73, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=a8c210f0-0302-4306-949e-a42cbb928e73,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:12.502146 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:12.508695 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ebdc0094-2623-47fa-9916-d0965dfadb7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:12.625776 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebdc0094-2623-47fa-9916-d0965dfadb7a None None] Pushing event updated for resources: {'Port': ['ID=a8c210f0-0302-4306-949e-a42cbb928e73,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:12.665021 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-0ef43e6d-497c-4d7e-aa58-efad884bce62 None None] Provisioning complete for port a8c210f0-0302-4306-949e-a42cbb928e73 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:12.665361 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-0ef43e6d-497c-4d7e-aa58-efad884bce62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:12.667950 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Allocated IP 172.20.0.1 (6623d855-6648-40fd-8a49-9c323edbff11/4b218758-bd28-403f-ac97-d980db9b78c8/3a13ccf0-993a-4501-8cda-0acd8d7cbf9a) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:58:12.730590 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:11Z', 'revision_number': 3, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:10Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:12.776873 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:12.777519 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Checking router: c3741b68-c75b-409c-9c20-6d6808f6e838 for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:58:12.777879 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Updating router c3741b68-c75b-409c-9c20-6d6808f6e838 port 226ec1ab-63e5-4186-886b-18e890bcbd84 binding host dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:58:12.814174 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:12.821966 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:12.829743 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 47814) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:12.864898 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Network 6623d855-6648-40fd-8a49-9c323edbff11 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:12.869545 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:12.872930 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:58:12.878669 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Pushing event updated for resources: {'Port': ['ID=3a13ccf0-993a-4501-8cda-0acd8d7cbf9a,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:12.894471 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fdc89ad6-2c36-43f8-b420-e7cc5e50d232 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:12.922036 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fdc89ad6-2c36-43f8-b420-e7cc5e50d232 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:12.925239 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1703675'] for router_interface, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:12.977506 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fdc89ad6-2c36-43f8-b420-e7cc5e50d232 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:12.981508 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fdc89ad6-2c36-43f8-b420-e7cc5e50d232 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:12.982986 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-fdc89ad6-2c36-43f8-b420-e7cc5e50d232 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "DELETE /v2.0/security-groups/38e9df07-f897-436d-ac60-fe287113cf14 HTTP/1.1" status: 204 len: 168 time: 0.1522355 Dec 20 05:58:12.986222 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47816) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:12.995201 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdc89ad6-2c36-43f8-b420-e7cc5e50d232 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=38e9df07-f897-436d-ac60-fe287113cf14,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:13.009041 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.api.v2.resource [None req-1613ede2-921c-48c6-8ac5-9bb22b2cbcf3 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] show failed (client error): The resource could not be found. Dec 20 05:58:13.010063 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-1613ede2-921c-48c6-8ac5-9bb22b2cbcf3 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups/38e9df07-f897-436d-ac60-fe287113cf14 HTTP/1.1" status: 404 len: 347 time: 0.0228055 Dec 20 05:58:13.013195 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 47818) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:13.091477 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.160828 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Publish callbacks [] for port, precommit_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.165984 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-8428133a-a3e0-4b92-889c-d281e219b270 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Deleting port 282f3699-8de1-47a6-9f34-99f6e5580c61 {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:58:13.166341 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8428133a-a3e0-4b92-889c-d281e219b270 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.166613 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.219816 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Attempting to bind port 226ec1ab-63e5-4186-886b-18e890bcbd84 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:58:13.220192 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Attempting to bind port 226ec1ab-63e5-4186-886b-18e890bcbd84 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:58:13.221114 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Attempting to bind port 226ec1ab-63e5-4186-886b-18e890bcbd84 on network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:58:13.223791 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7026094-ff31-48c1-b73b-0311605d59aa None None] Pushing event updated for resources: {'Port': ['ID=226ec1ab-63e5-4186-886b-18e890bcbd84,revision_number=2']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:13.235154 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 58, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:58:13.235552 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Checking segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:58:13.235965 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.236844 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Bound using segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:58:13.236844 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Bound port: 226ec1ab-63e5-4186-886b-18e890bcbd84, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:58:13.237196 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.251583 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8428133a-a3e0-4b92-889c-d281e219b270 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.251911 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8428133a-a3e0-4b92-889c-d281e219b270 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.264264 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-8428133a-a3e0-4b92-889c-d281e219b270 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Calling delete_port for 282f3699-8de1-47a6-9f34-99f6e5580c61 owned by network:floatingip {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:58:13.275121 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-cb97b619-44cf-4d63-9192-2b62c6d91d1f None None] Provisioning complete for port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:13.275373 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-cb97b619-44cf-4d63-9192-2b62c6d91d1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.287272 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.292271 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.329242 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-cb97b619-44cf-4d63-9192-2b62c6d91d1f None None] Port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:58:13.332924 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] For port 226ec1ab-63e5-4186-886b-18e890bcbd84, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:58:13.336432 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1617520', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1697131'] for router_interface, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.336880 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] For port 226ec1ab-63e5-4186-886b-18e890bcbd84, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=226ec1ab-63e5-4186-886b-18e890bcbd84,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:58:13.344972 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.409957 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7026094-ff31-48c1-b73b-0311605d59aa None None] Pushing event updated for resources: {'Port': ['ID=226ec1ab-63e5-4186-886b-18e890bcbd84,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:13.415754 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Routers {'c3741b68-c75b-409c-9c20-6d6808f6e838'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:13.415925 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Pushing event updated for resources: {'Port': ['ID=3a13ccf0-993a-4501-8cda-0acd8d7cbf9a,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:13.416368 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['c3741b68-c75b-409c-9c20-6d6808f6e838'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:13.436088 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8428133a-a3e0-4b92-889c-d281e219b270 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.470498 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8428133a-a3e0-4b92-889c-d281e219b270 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event deleted for resources: {'Port': ['ID=282f3699-8de1-47a6-9f34-99f6e5580c61,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:13.487880 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Network 6623d855-6648-40fd-8a49-9c323edbff11 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:13.490243 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:13.537350 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8428133a-a3e0-4b92-889c-d281e219b270 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for floatingip, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.540649 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-8428133a-a3e0-4b92-889c-d281e219b270 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.540806 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] Set router c3741b68-c75b-409c-9c20-6d6808f6e838 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:13.541838 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-8428133a-a3e0-4b92-889c-d281e219b270 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "DELETE /v2.0/floatingips/d1719efe-7c3d-4c2b-8a5a-91c7554f551c HTTP/1.1" status: 204 len: 168 time: 0.5273142 Dec 20 05:58:13.571868 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device abed4d23-da46-4f59-9f36-c9fc12fcb192 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:58:13.611154 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: abed4d23-da46-4f59-9f36-c9fc12fcb192 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:58:13.611504 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device abed4d23-da46-4f59-9f36-c9fc12fcb192 not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:58:13.636422 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Router c3741b68-c75b-409c-9c20-6d6808f6e838 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:58:13.772213 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:58:13.782240 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-530bc837-4a35-4972-84df-464a66d5d970 admin admin] 10.222.0.46 "PUT /v2.0/routers/c3741b68-c75b-409c-9c20-6d6808f6e838/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7292440 Dec 20 05:58:13.793768 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-0ac7418e-ebe0-429c-9e87-f476dfd68a09 None None] Provisioning complete for port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:13.794303 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-0ac7418e-ebe0-429c-9e87-f476dfd68a09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.807236 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47830) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:13.812040 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-b40bed19-d295-4945-a5aa-96df7456f800 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Request body: {'security_group': {'name': 'tempest-securitygroup--2105752638', 'description': 'tempest-description--269382431'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:13.838818 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b40bed19-d295-4945-a5aa-96df7456f800 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.859301 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-0ac7418e-ebe0-429c-9e87-f476dfd68a09 None None] Port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:58:13.910797 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 2, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:13.928011 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b40bed19-d295-4945-a5aa-96df7456f800 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.932810 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b40bed19-d295-4945-a5aa-96df7456f800 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.940866 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-089e537f-3cc2-41c4-ba37-1e35d63dec7e None None] The sync data for ids ['c3741b68-c75b-409c-9c20-6d6808f6e838'] in dv-cinder-822278-1-iscsi is: [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 2, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:58:13.977902 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b40bed19-d295-4945-a5aa-96df7456f800 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:13.978722 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:58:13.980265 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-b40bed19-d295-4945-a5aa-96df7456f800 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1716256 Dec 20 05:58:13.981674 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b40bed19-d295-4945-a5aa-96df7456f800 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event updated for resources: {'SecurityGroup': ['ID=389c1ab1-5cef-451a-a23b-8602a35f4d94,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:13.981821 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device a8c210f0-0302-4306-949e-a42cbb928e73 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:13.983342 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 47836) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:13.989200 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-acabe86e-89dc-4274-b3b0-c82569051ca1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Request body: {'security_group_rule': {'security_group_id': '389c1ab1-5cef-451a-a23b-8602a35f4d94', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:14.029872 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-acabe86e-89dc-4274-b3b0-c82569051ca1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.104405 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-acabe86e-89dc-4274-b3b0-c82569051ca1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.109927 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-acabe86e-89dc-4274-b3b0-c82569051ca1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.125136 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acabe86e-89dc-4274-b3b0-c82569051ca1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c84f7968-bae3-4944-ae9c-0b214567fc8b,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:14.140489 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-acabe86e-89dc-4274-b3b0-c82569051ca1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.142079 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-acabe86e-89dc-4274-b3b0-c82569051ca1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1576898 Dec 20 05:58:14.145947 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47838) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:14.151072 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-77f344f0-9359-4182-aded-8421887f4762 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Request body: {'security_group_rule': {'security_group_id': '389c1ab1-5cef-451a-a23b-8602a35f4d94', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:14.182710 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-77f344f0-9359-4182-aded-8421887f4762 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.195551 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port a8c210f0-0302-4306-949e-a42cbb928e73 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:14.196110 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.270131 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-77f344f0-9359-4182-aded-8421887f4762 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.274197 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-77f344f0-9359-4182-aded-8421887f4762 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.298483 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77f344f0-9359-4182-aded-8421887f4762 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9cc77b1d-5711-4168-b3d9-ef0edc02185f,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:14.306874 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-77f344f0-9359-4182-aded-8421887f4762 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.311236 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-77f344f0-9359-4182-aded-8421887f4762 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1608961 Dec 20 05:58:14.313584 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 47840) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:14.317803 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Request body: {'floatingip': {'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:14.348758 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for floatingip, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.465177 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.466583 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47842) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:14.471165 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-73ccfe14-8cfe-4223-9460-be3e8bd25717 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Request body: {'security_group': {'name': 'tempest-securitygroup--383958313', 'description': 'tempest-description--1249257915'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:14.497355 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-73ccfe14-8cfe-4223-9460-be3e8bd25717 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.575799 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-73ccfe14-8cfe-4223-9460-be3e8bd25717 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.580297 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-73ccfe14-8cfe-4223-9460-be3e8bd25717 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.586598 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Allocated IP 172.27.3.17 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/bff044dc-232a-4d68-adcc-42ca79ee3945) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:58:14.609497 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-73ccfe14-8cfe-4223-9460-be3e8bd25717 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.610641 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-73ccfe14-8cfe-4223-9460-be3e8bd25717 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1430001 Dec 20 05:58:14.613849 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 47844) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:14.619472 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-7833064e-f5fd-4128-8282-0b9f98cd2180 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Request body: {'security_group_rule': {'security_group_id': '6a99c56d-84ca-41c4-b5e3-94d98389342a', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:14.622422 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73ccfe14-8cfe-4223-9460-be3e8bd25717 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6a99c56d-84ca-41c4-b5e3-94d98389342a,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:14.694741 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-7833064e-f5fd-4128-8282-0b9f98cd2180 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.757065 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.797612 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-7833064e-f5fd-4128-8282-0b9f98cd2180 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.804961 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-7833064e-f5fd-4128-8282-0b9f98cd2180 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.841624 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7833064e-f5fd-4128-8282-0b9f98cd2180 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=de72c605-276e-41ab-b91c-2f22c474bad2,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:14.854843 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-7833064e-f5fd-4128-8282-0b9f98cd2180 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.856218 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-7833064e-f5fd-4128-8282-0b9f98cd2180 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2411957 Dec 20 05:58:14.858174 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.858946 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47850) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:14.864068 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-ad31b262-e233-4296-bf6e-d3ffc9806d34 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Request body: {'security_group_rule': {'security_group_id': '6a99c56d-84ca-41c4-b5e3-94d98389342a', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:14.902785 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:14.905858 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:14.912292 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:58:14.913349 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ad31b262-e233-4296-bf6e-d3ffc9806d34 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.939891 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event updated for resources: {'Port': ['ID=bff044dc-232a-4d68-adcc-42ca79ee3945,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:14.987266 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ad31b262-e233-4296-bf6e-d3ffc9806d34 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:14.991691 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ad31b262-e233-4296-bf6e-d3ffc9806d34 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:15.009178 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:15.012911 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad31b262-e233-4296-bf6e-d3ffc9806d34 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=55f4215a-615d-4a5b-b280-1b3b4baa5742,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:15.027745 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ad31b262-e233-4296-bf6e-d3ffc9806d34 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:15.029166 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-ad31b262-e233-4296-bf6e-d3ffc9806d34 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1687655 Dec 20 05:58:15.032127 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 47854) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:15.036682 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Request body: {'floatingip': {'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:15.052080 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:15.068148 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for floatingip, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:15.184419 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:15.234781 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:15.240062 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:15.314940 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event updated for resources: {'Port': ['ID=bff044dc-232a-4d68-adcc-42ca79ee3945,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:15.328178 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:15.345706 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:15.355429 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-fc61bbab-17a4-400b-8009-6ff15cc2d182 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.0344391 Dec 20 05:58:15.538512 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Allocated IP 172.27.3.15 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/ec8ae0eb-6f7d-40a8-8125-14fa48c27274) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:58:15.571819 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-0c14d166-7135-44f0-8067-eed96e9c81eb tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?name=tempest-securitygroup--2105752638&fields=id&tenant_id=1898b7c1b3dc4523b09a97486622c67e HTTP/1.1" status: 200 len: 267 time: 0.0430608 Dec 20 05:58:15.643909 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:15.678171 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:15.683673 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-d86a588e-c98e-4ce1-83a4-366aec8733a2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:15.685168 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-d86a588e-c98e-4ce1-83a4-366aec8733a2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/networks?id=6924a88e-10c1-4073-a41c-88aad14ebd0f HTTP/1.1" status: 200 len: 811 time: 0.1060650 Dec 20 05:58:15.700773 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-38fa4a84-1908-458f-bd8e-030f673581a6 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/quotas/1898b7c1b3dc4523b09a97486622c67e HTTP/1.1" status: 200 len: 375 time: 0.0095286 Dec 20 05:58:15.717421 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:15.720350 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:15.723773 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:58:15.746634 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event updated for resources: {'Port': ['ID=ec8ae0eb-6f7d-40a8-8125-14fa48c27274,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:15.751960 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-44dd41c5-bf91-4b06-9b2b-2d9a50a2237e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=1898b7c1b3dc4523b09a97486622c67e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0452681 Dec 20 05:58:15.859400 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-9195c2a9-d65e-4613-b0fb-6ffef203bbb0 service neutron] 10.222.0.46 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0939698 Dec 20 05:58:15.870945 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:15.920806 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:15.961759 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-eda0bf76-9253-4fcd-852f-d2f4ff843261 service neutron] 10.222.0.46 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0974836 Dec 20 05:58:15.987100 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 226ec1ab-63e5-4186-886b-18e890bcbd84 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:16.073649 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 226ec1ab-63e5-4186-886b-18e890bcbd84 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:16.074019 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:16.141590 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:16.151767 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:16.191569 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-180df14e-a786-449d-b138-fc527e0d4e02 req-53589c1e-e1c1-4295-bd37-288ff9b08fcd tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 210 time: 0.0438623 Dec 20 05:58:16.194042 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:16.228403 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port 226ec1ab-63e5-4186-886b-18e890bcbd84, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=226ec1ab-63e5-4186-886b-18e890bcbd84,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:16.235452 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:16.271854 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event updated for resources: {'Port': ['ID=ec8ae0eb-6f7d-40a8-8125-14fa48c27274,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:16.278641 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:16.297488 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:16.299005 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=226ec1ab-63e5-4186-886b-18e890bcbd84,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:16.309083 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-4128e686-6742-42eb-b19e-ae5896f08e8e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.2755394 Dec 20 05:58:16.412515 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Sync routers for ids ['c3741b68-c75b-409c-9c20-6d6808f6e838'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:58:16.423631 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Routers {'c3741b68-c75b-409c-9c20-6d6808f6e838'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:16.424485 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['c3741b68-c75b-409c-9c20-6d6808f6e838'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:16.465502 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-8b0f92cc-3c0e-48c5-a508-4e8de8953b06 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?name=tempest-securitygroup--383958313&fields=id&tenant_id=60c21858b1c7408daa963605a7c691c0 HTTP/1.1" status: 200 len: 267 time: 0.0576980 Dec 20 05:58:16.683725 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Set router c3741b68-c75b-409c-9c20-6d6808f6e838 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:16.782849 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-560d51b6-885d-4809-8539-53f143bd9ed7 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:16.785109 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-560d51b6-885d-4809-8539-53f143bd9ed7 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 816 time: 0.3177891 Dec 20 05:58:16.801106 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-d14704ea-5e89-4d53-a8d1-e665ee9d7bcc tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/quotas/60c21858b1c7408daa963605a7c691c0 HTTP/1.1" status: 200 len: 375 time: 0.0098166 Dec 20 05:58:16.860509 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-46523010-849f-4ac6-a5bc-7b2a3dcd28d1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0536683 Dec 20 05:58:16.942204 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 2, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:16.975562 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-9c9c5455-5d36-464a-9fce-33e0ed1c8e27 service neutron] 10.222.0.46 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0976365 Dec 20 05:58:16.980320 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Checking router: c3741b68-c75b-409c-9c20-6d6808f6e838 for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:58:16.980667 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Updating router c3741b68-c75b-409c-9c20-6d6808f6e838 port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a binding host dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:58:17.008030 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:17.069362 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-92f00efb-95fa-4b6e-898d-2f625dfee64a service neutron] 10.222.0.46 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861349 Dec 20 05:58:17.267357 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f3961697-3a5a-4d74-947d-adaa0f4f7a4e req-c1e22bc2-1fd6-4aff-b1a3-d6c587035436 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 210 time: 0.0478384 Dec 20 05:58:17.300438 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Publish callbacks [] for port, precommit_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:17.306887 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:17.318285 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dafe7428-7889-4a84-bcd2-6c6bb4e5ac54 req-d6353798-7ea4-4728-b056-19cc96fe27ea tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 210 time: 0.0286372 Dec 20 05:58:17.417153 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Pushing event updated for resources: {'Port': ['ID=3a13ccf0-993a-4501-8cda-0acd8d7cbf9a,revision_number=3']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:17.458316 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:17.460193 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:17.461604 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:17.462505 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:17.463561 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:17.464239 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:17.464913 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:17.465465 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:17.466118 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:17.466720 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:17.467335 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:17.467945 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:17.468671 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102448) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:17.487600 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Attempting to bind port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:58:17.488168 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Attempting to bind port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:58:17.489484 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Attempting to bind port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a on network 6623d855-6648-40fd-8a49-9c323edbff11 {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:58:17.496416 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 58, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:58:17.497084 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Checking segment: {'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102448) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:58:17.497656 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:17.498216 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Bound using segment: {'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:58:17.498867 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Bound port: 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'}}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:58:17.499436 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:17.606474 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] For port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102448) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:58:17.610487 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] For port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=3a13ccf0-993a-4501-8cda-0acd8d7cbf9a,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102448) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:58:17.620369 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-4d395503-faa2-4f03-a0ac-00b11da4b4ae tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:17.621914 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:17.623629 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-4d395503-faa2-4f03-a0ac-00b11da4b4ae tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.54 "GET /v2.0/networks?id=6924a88e-10c1-4073-a41c-88aad14ebd0f HTTP/1.1" status: 200 len: 811 time: 0.2367997 Dec 20 05:58:17.729938 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Routers {'c3741b68-c75b-409c-9c20-6d6808f6e838'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:17.730657 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['c3741b68-c75b-409c-9c20-6d6808f6e838'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:17.770056 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a1c5ab-448a-4cd5-ad41-92f77aba88ce None None] Pushing event updated for resources: {'Port': ['ID=3a13ccf0-993a-4501-8cda-0acd8d7cbf9a,revision_number=4']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:17.790923 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-696c3d82-7fb5-4e56-9930-b3a7f5f05628 req-bdd69a29-4567-45f4-93e0-eae816f85302 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:17.802437 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-696c3d82-7fb5-4e56-9930-b3a7f5f05628 req-bdd69a29-4567-45f4-93e0-eae816f85302 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 946 time: 0.0817974 Dec 20 05:58:17.816503 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-06189adf-125c-41e3-9e6a-6c0c67f90d53 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1898b7c1b3dc4523b09a97486622c67e HTTP/1.1" status: 200 len: 380 time: 0.1686347 Dec 20 05:58:17.817888 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-d5e5e305-482d-4d84-9db7-f30eaf4f8431 None None] Provisioning complete for port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:17.818507 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-d5e5e305-482d-4d84-9db7-f30eaf4f8431 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:17.831579 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-77b00145-17f1-49a3-adbe-b8f104743a63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Request body: {'port': {'device_id': '0b14fdd5-af46-4268-a3b8-06d9f0a9196b', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'admin_state_up': True, 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'security_groups': ['389c1ab1-5cef-451a-a23b-8602a35f4d94']}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:17.885867 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-696c3d82-7fb5-4e56-9930-b3a7f5f05628 req-72317697-e218-4a06-8c43-ba0f7db9fca3 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822155 Dec 20 05:58:17.890009 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] Set router c3741b68-c75b-409c-9c20-6d6808f6e838 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:17.951336 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-d5e5e305-482d-4d84-9db7-f30eaf4f8431 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:18.028401 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-d5e5e305-482d-4d84-9db7-f30eaf4f8431 None None] For port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=3a13ccf0-993a-4501-8cda-0acd8d7cbf9a,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:18.035357 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:18.039142 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-d5e5e305-482d-4d84-9db7-f30eaf4f8431 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:18.064446 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-77b00145-17f1-49a3-adbe-b8f104743a63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Made reservation on behalf of 1898b7c1b3dc4523b09a97486622c67e for: {'port': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:58:18.068597 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-77b00145-17f1-49a3-adbe-b8f104743a63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:18.150373 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5e5e305-482d-4d84-9db7-f30eaf4f8431 None None] Pushing event updated for resources: {'Port': ['ID=3a13ccf0-993a-4501-8cda-0acd8d7cbf9a,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:18.177359 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:18.178000 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:18.181160 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-6c8e622d-554c-46d6-a7a9-577e83602ad3 None None] Provisioning complete for port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:18.181702 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-6c8e622d-554c-46d6-a7a9-577e83602ad3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:18.217316 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:17Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:18.233434 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-77b00145-17f1-49a3-adbe-b8f104743a63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Allocated IP 172.20.0.4 (6924a88e-10c1-4073-a41c-88aad14ebd0f/ffb588f9-2ffb-4921-8a76-be5179c2fbed/99279753-6934-4d6f-88dc-e3785468af1d) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:58:18.246438 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9e9f1d4-3181-4c1c-98f5-35be709360d4 None None] The sync data for ids ['c3741b68-c75b-409c-9c20-6d6808f6e838'] in dv-cinder-822278-1-iscsi is: [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:17Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:58:18.330711 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 226ec1ab-63e5-4186-886b-18e890bcbd84 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:18.391132 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 226ec1ab-63e5-4186-886b-18e890bcbd84 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:18.391502 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:18.444443 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7dadec94-507f-4966-9d2e-3658ec449a10 req-748f488b-a770-4512-a082-94b28b59e438 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 210 time: 0.0656223 Dec 20 05:58:18.452547 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-77b00145-17f1-49a3-adbe-b8f104743a63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:18.482815 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bebcd79e-9e58-44df-8d26-21440d0c276f req-948d8db3-ad39-4055-88b1-eabb76386780 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 210 time: 0.0782573 Dec 20 05:58:18.513376 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-77b00145-17f1-49a3-adbe-b8f104743a63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:18.561167 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-77b00145-17f1-49a3-adbe-b8f104743a63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Network 6924a88e-10c1-4073-a41c-88aad14ebd0f is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:18.564326 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-77b00145-17f1-49a3-adbe-b8f104743a63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:18.569197 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-77b00145-17f1-49a3-adbe-b8f104743a63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:58:18.573519 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77b00145-17f1-49a3-adbe-b8f104743a63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event updated for resources: {'Port': ['ID=99279753-6934-4d6f-88dc-e3785468af1d,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:18.631590 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-77b00145-17f1-49a3-adbe-b8f104743a63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:18.632293 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-77b00145-17f1-49a3-adbe-b8f104743a63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:18.652623 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-77b00145-17f1-49a3-adbe-b8f104743a63 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8255124 Dec 20 05:58:18.689868 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Request body: {'port': {'device_id': '0b14fdd5-af46-4268-a3b8-06d9f0a9196b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:18.802737 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-c08db4c2-1247-4f2e-85d5-53355210326f None None] Provisioning complete for port 99279753-6934-4d6f-88dc-e3785468af1d triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:18.803389 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-c08db4c2-1247-4f2e-85d5-53355210326f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:18.805221 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:18.852563 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-c08db4c2-1247-4f2e-85d5-53355210326f None None] Port 99279753-6934-4d6f-88dc-e3785468af1d cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:58:18.861066 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-bb35c883-9c91-4b5d-8b0e-dafd2f6bcfcc tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:18.862566 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-bb35c883-9c91-4b5d-8b0e-dafd2f6bcfcc tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.54 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 816 time: 0.1376634 Dec 20 05:58:18.939912 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-9edb4b2c-4156-4fb3-8369-1c49d9996b97 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=60c21858b1c7408daa963605a7c691c0 HTTP/1.1" status: 200 len: 379 time: 0.0615485 Dec 20 05:58:18.956691 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-0ae06811-c5a3-4bf7-abaa-a87da9dea9fb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Request body: {'port': {'device_id': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'admin_state_up': True, 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'security_groups': ['6a99c56d-84ca-41c4-b5e3-94d98389342a']}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:19.082934 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5ee2d58-898c-482b-b06f-79bec8563ed4 req-af2cd086-17a6-4dc2-96d6-c9edbdf706c2 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:19.084432 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d5ee2d58-898c-482b-b06f-79bec8563ed4 req-af2cd086-17a6-4dc2-96d6-c9edbdf706c2 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 946 time: 0.0950623 Dec 20 05:58:19.122031 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 99279753-6934-4d6f-88dc-e3785468af1d {{(pid=102446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:58:19.129720 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:19.142549 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.provisioning_blocks [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Transition to ACTIVE for port object 99279753-6934-4d6f-88dc-e3785468af1d will not be triggered until provisioned by entity L2. {{(pid=102446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 05:58:19.146042 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:19.154433 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d5ee2d58-898c-482b-b06f-79bec8563ed4 req-c29c10a0-1d03-4c88-bd7e-93e223b780cc tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0629168 Dec 20 05:58:19.155470 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-0ae06811-c5a3-4bf7-abaa-a87da9dea9fb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Made reservation on behalf of 60c21858b1c7408daa963605a7c691c0 for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:58:19.159098 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-0ae06811-c5a3-4bf7-abaa-a87da9dea9fb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:19.200644 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Pushing event updated for resources: {'Port': ['ID=99279753-6934-4d6f-88dc-e3785468af1d,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:19.272484 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Attempting to bind port 99279753-6934-4d6f-88dc-e3785468af1d on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:58:19.272827 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Attempting to bind port 99279753-6934-4d6f-88dc-e3785468af1d by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'}] {{(pid=102446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:58:19.273251 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Attempting to bind port 99279753-6934-4d6f-88dc-e3785468af1d on network 6924a88e-10c1-4073-a41c-88aad14ebd0f {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:58:19.277635 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Port 99279753-6934-4d6f-88dc-e3785468af1d on network 6924a88e-10c1-4073-a41c-88aad14ebd0f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 05:58:19.277961 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Attempting to bind port 99279753-6934-4d6f-88dc-e3785468af1d on network 6924a88e-10c1-4073-a41c-88aad14ebd0f {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:58:19.283020 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 58, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:58:19.283363 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Checking segment: {'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:58:19.283778 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Bound using segment: {'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'} {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:58:19.284799 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Bound port: 99279753-6934-4d6f-88dc-e3785468af1d, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4c69b482-aa23-4498-a353-7596fb491ef0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f'}}] {{(pid=102446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:58:19.285162 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:19.299250 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-0ae06811-c5a3-4bf7-abaa-a87da9dea9fb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Allocated IP 172.20.0.10 (6623d855-6648-40fd-8a49-9c323edbff11/4b218758-bd28-403f-ac97-d980db9b78c8/9e825da9-eb60-4572-8a89-92caa8cddaa2) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:58:19.354405 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] For port 99279753-6934-4d6f-88dc-e3785468af1d, host hv-cinder-82227, cleared binding levels {{(pid=102446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:58:19.357641 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] For port 99279753-6934-4d6f-88dc-e3785468af1d, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=99279753-6934-4d6f-88dc-e3785468af1d,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:58:19.362913 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:19.403598 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:19.404241 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:19.405638 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] 10.222.0.54 "PUT /v2.0/ports/99279753-6934-4d6f-88dc-e3785468af1d HTTP/1.1" status: 200 len: 1093 time: 0.7204075 Dec 20 05:58:19.406082 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0b14fdd5-af46-4268-a3b8-06d9f0a9196b', 'tag': '99279753-6934-4d6f-88dc-e3785468af1d'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:58:19.408365 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-489860c6-abbd-4349-8ff0-d9ad68b41cda" -d '{"events": [{"name": "network-changed", "server_uuid": "0b14fdd5-af46-4268-a3b8-06d9f0a9196b", "tag": "99279753-6934-4d6f-88dc-e3785468af1d"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:58:19.439047 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1a9d124-627c-4be0-ae97-719c0b8754bf service neutron] Pushing event updated for resources: {'Port': ['ID=99279753-6934-4d6f-88dc-e3785468af1d,revision_number=3']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:19.452193 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:58:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1396f634-4298-4ba5-9639-f286093cebc1 x-openstack-request-id: req-1396f634-4298-4ba5-9639-f286093cebc1 {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:58:19.452641 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0b14fdd5-af46-4268-a3b8-06d9f0a9196b", "tag": "99279753-6934-4d6f-88dc-e3785468af1d", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:58:19.453126 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-1396f634-4298-4ba5-9639-f286093cebc1 {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:58:19.453859 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0b14fdd5-af46-4268-a3b8-06d9f0a9196b', 'tag': '99279753-6934-4d6f-88dc-e3785468af1d', 'status': 'completed', 'code': 200} Dec 20 05:58:19.454766 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-0ae06811-c5a3-4bf7-abaa-a87da9dea9fb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:19.498701 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-0ae06811-c5a3-4bf7-abaa-a87da9dea9fb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:19.550850 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-1f1d3ec8-d491-48db-b07a-9977b67baa79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:19.553221 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-1f1d3ec8-d491-48db-b07a-9977b67baa79 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1898b7c1b3dc4523b09a97486622c67e&device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 1096 time: 0.0662541 Dec 20 05:58:19.597981 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-0ae06811-c5a3-4bf7-abaa-a87da9dea9fb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Network 6623d855-6648-40fd-8a49-9c323edbff11 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:19.614560 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-0ae06811-c5a3-4bf7-abaa-a87da9dea9fb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:19.615641 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-8c78a129-3baa-4cc0-853d-e27f413fc4dd service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99279753-6934-4d6f-88dc-e3785468af1d HTTP/1.1" status: 200 len: 217 time: 0.0389824 Dec 20 05:58:19.636023 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-0ae06811-c5a3-4bf7-abaa-a87da9dea9fb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:58:19.638634 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ae06811-c5a3-4bf7-abaa-a87da9dea9fb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event updated for resources: {'Port': ['ID=9e825da9-eb60-4572-8a89-92caa8cddaa2,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:19.675088 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-490aa908-8f6d-42f7-8849-8cc1bf012c8b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:19.676662 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-490aa908-8f6d-42f7-8849-8cc1bf012c8b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ffb588f9-2ffb-4921-8a76-be5179c2fbed HTTP/1.1" status: 200 len: 850 time: 0.0531766 Dec 20 05:58:19.705393 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d7d5d11-7bc1-4c39-8171-9058fcdcfc96 req-7f637972-70c1-4ce4-8964-2cd9bc96422a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:19.713394 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d7d5d11-7bc1-4c39-8171-9058fcdcfc96 req-7f637972-70c1-4ce4-8964-2cd9bc96422a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 932 time: 0.1585517 Dec 20 05:58:19.729071 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8faf78b-1aca-4581-a003-f857f060face req-3e2b2c2b-f414-4918-88f1-5d456dd5c7ff tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:19.730579 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e8faf78b-1aca-4581-a003-f857f060face req-3e2b2c2b-f414-4918-88f1-5d456dd5c7ff tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 943 time: 0.1370184 Dec 20 05:58:19.738040 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-0ae06811-c5a3-4bf7-abaa-a87da9dea9fb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:19.738890 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-0ae06811-c5a3-4bf7-abaa-a87da9dea9fb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:19.742709 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-c0c7c6d8-acc4-44b3-9ce3-35ee942208de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:19.744850 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-c0c7c6d8-acc4-44b3-9ce3-35ee942208de service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6924a88e-10c1-4073-a41c-88aad14ebd0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0600688 Dec 20 05:58:19.779087 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-0ae06811-c5a3-4bf7-abaa-a87da9dea9fb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8266156 Dec 20 05:58:19.806771 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Request body: {'port': {'device_id': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:19.850439 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e8faf78b-1aca-4581-a003-f857f060face req-a1e55a30-ac81-4907-bf55-320cd36dbd93 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1079543 Dec 20 05:58:19.856647 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0d7d5d11-7bc1-4c39-8171-9058fcdcfc96 req-087366ef-5be7-4c08-95bb-3aa0ba9a69a1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1424241 Dec 20 05:58:19.887214 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-ba367353-1d60-4ed2-92df-d7a3a08e3b41 service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1076748 Dec 20 05:58:19.902673 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:19.939466 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-f1063296-82ef-409f-92ba-7ca59b253b34 None None] Provisioning complete for port 9e825da9-eb60-4572-8a89-92caa8cddaa2 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:19.940069 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f1063296-82ef-409f-92ba-7ca59b253b34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:19.967557 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:19.993755 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-7ce4afdf-a480-4b53-9d60-6d67301f914f req-768f9c75-39c6-446f-adac-c05e1149fe2c service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0982699 Dec 20 05:58:20.018606 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-f1063296-82ef-409f-92ba-7ca59b253b34 None None] Port 9e825da9-eb60-4572-8a89-92caa8cddaa2 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:58:20.033156 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:20.033523 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:20.094802 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb19fb7b-6e87-4203-a291-3e541e1a860d req-d38aa3cd-34ab-4323-8d94-14e37bbd58a3 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:20.096225 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-eb19fb7b-6e87-4203-a291-3e541e1a860d req-d38aa3cd-34ab-4323-8d94-14e37bbd58a3 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.54 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 946 time: 0.0510778 Dec 20 05:58:20.177637 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9e825da9-eb60-4572-8a89-92caa8cddaa2 {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:58:20.185958 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:20.198757 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Transition to ACTIVE for port object 9e825da9-eb60-4572-8a89-92caa8cddaa2 will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 05:58:20.202613 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:20.215299 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489860c6-abbd-4349-8ff0-d9ad68b41cda req-9da6f20f-0b69-4472-ab8c-7fba64c9ce19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:20.216846 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-489860c6-abbd-4349-8ff0-d9ad68b41cda req-9da6f20f-0b69-4472-ab8c-7fba64c9ce19 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1898b7c1b3dc4523b09a97486622c67e&device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 1096 time: 0.0941830 Dec 20 05:58:20.286895 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Pushing event updated for resources: {'Port': ['ID=9e825da9-eb60-4572-8a89-92caa8cddaa2,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:20.290183 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-eb19fb7b-6e87-4203-a291-3e541e1a860d req-d56d74ec-c95d-48bf-a638-e54398d02a50 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Deleting port ba178573-06ff-41da-95d0-ecc4c7c453b9 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:58:20.290530 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-eb19fb7b-6e87-4203-a291-3e541e1a860d req-d56d74ec-c95d-48bf-a638-e54398d02a50 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:20.360190 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3030f0d-bae3-4056-b41d-2664350d0635 req-ac074e89-31a4-4899-ae9d-efacccae3cf0 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:20.361281 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d3030f0d-bae3-4056-b41d-2664350d0635 req-ac074e89-31a4-4899-ae9d-efacccae3cf0 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/ports?device_id=d63d89bf-797a-4e53-b11e-6dd04664529f HTTP/1.1" status: 200 len: 946 time: 0.1279125 Dec 20 05:58:20.383735 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489860c6-abbd-4349-8ff0-d9ad68b41cda req-bfe6a8e7-30e6-4e6c-a707-48babe765ea4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:20.383735 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-489860c6-abbd-4349-8ff0-d9ad68b41cda req-bfe6a8e7-30e6-4e6c-a707-48babe765ea4 service neutron] 10.222.0.54 "GET /v2.0/networks?id=6924a88e-10c1-4073-a41c-88aad14ebd0f HTTP/1.1" status: 200 len: 912 time: 0.1565430 Dec 20 05:58:20.400614 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Attempting to bind port 9e825da9-eb60-4572-8a89-92caa8cddaa2 on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:58:20.401352 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Attempting to bind port 9e825da9-eb60-4572-8a89-92caa8cddaa2 by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:58:20.401352 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Attempting to bind port 9e825da9-eb60-4572-8a89-92caa8cddaa2 on network 6623d855-6648-40fd-8a49-9c323edbff11 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:58:20.413959 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Port 9e825da9-eb60-4572-8a89-92caa8cddaa2 on network 6623d855-6648-40fd-8a49-9c323edbff11 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 05:58:20.414288 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Attempting to bind port 9e825da9-eb60-4572-8a89-92caa8cddaa2 on network 6623d855-6648-40fd-8a49-9c323edbff11 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:58:20.430997 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 58, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:58:20.431351 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Checking segment: {'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:58:20.431685 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-489860c6-abbd-4349-8ff0-d9ad68b41cda req-3d5996ce-6a38-498d-98a5-0df3baf60649 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99279753-6934-4d6f-88dc-e3785468af1d HTTP/1.1" status: 200 len: 217 time: 0.0398993 Dec 20 05:58:20.431808 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Bound using segment: {'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:58:20.432160 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Bound port: 9e825da9-eb60-4572-8a89-92caa8cddaa2, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:58:20.432607 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:20.443702 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-eb19fb7b-6e87-4203-a291-3e541e1a860d req-d56d74ec-c95d-48bf-a638-e54398d02a50 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] For port ba178573-06ff-41da-95d0-ecc4c7c453b9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=ba178573-06ff-41da-95d0-ecc4c7c453b9,segment=NetworkSegment(62bdd930-d981-4fed-ad58-9d410d5c0393),segment_id=62bdd930-d981-4fed-ad58-9d410d5c0393)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:20.444070 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-eb19fb7b-6e87-4203-a291-3e541e1a860d req-d56d74ec-c95d-48bf-a638-e54398d02a50 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:20.444216 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d3030f0d-bae3-4056-b41d-2664350d0635 req-4320bbd3-7e32-48e5-858c-6e7ee4a22233 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.46 "GET /v2.0/security-groups?id=86dd8038-82cb-4fbf-954a-3aaaf1887354&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0726795 Dec 20 05:58:20.485335 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-eb19fb7b-6e87-4203-a291-3e541e1a860d req-d56d74ec-c95d-48bf-a638-e54398d02a50 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Calling delete_port for ba178573-06ff-41da-95d0-ecc4c7c453b9 owned by compute:nova {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:58:20.502857 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] For port 9e825da9-eb60-4572-8a89-92caa8cddaa2, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:58:20.505768 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] For port 9e825da9-eb60-4572-8a89-92caa8cddaa2, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:58:20.510434 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:20.537734 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489860c6-abbd-4349-8ff0-d9ad68b41cda req-7943e6a1-345d-4f69-9fc1-99cec69a8f20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:20.539783 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-489860c6-abbd-4349-8ff0-d9ad68b41cda req-7943e6a1-345d-4f69-9fc1-99cec69a8f20 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ffb588f9-2ffb-4921-8a76-be5179c2fbed HTTP/1.1" status: 200 len: 850 time: 0.0981295 Dec 20 05:58:20.547736 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:20.548465 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:20.550016 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] 10.222.0.54 "PUT /v2.0/ports/9e825da9-eb60-4572-8a89-92caa8cddaa2 HTTP/1.1" status: 200 len: 1094 time: 0.7493382 Dec 20 05:58:20.550452 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'tag': '9e825da9-eb60-4572-8a89-92caa8cddaa2'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:58:20.552791 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1fded32a-209f-416f-81ac-da24a5add543" -d '{"events": [{"name": "network-changed", "server_uuid": "8e0ee236-8474-4f2a-b875-752d3dec628f", "tag": "9e825da9-eb60-4572-8a89-92caa8cddaa2"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:58:20.586368 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32308897-610f-41ef-9b5d-25c6b586223a service neutron] Pushing event updated for resources: {'Port': ['ID=9e825da9-eb60-4572-8a89-92caa8cddaa2,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:20.611924 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:58:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96c5b400-bf83-4000-8e73-711c6886a99e x-openstack-request-id: req-96c5b400-bf83-4000-8e73-711c6886a99e {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:58:20.612229 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8e0ee236-8474-4f2a-b875-752d3dec628f", "tag": "9e825da9-eb60-4572-8a89-92caa8cddaa2", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:58:20.612466 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-96c5b400-bf83-4000-8e73-711c6886a99e {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:58:20.612864 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'tag': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'status': 'completed', 'code': 200} Dec 20 05:58:20.653989 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489860c6-abbd-4349-8ff0-d9ad68b41cda req-1db27fa6-2c27-4094-b0d2-8d0940bb9ceb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:20.655609 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-489860c6-abbd-4349-8ff0-d9ad68b41cda req-1db27fa6-2c27-4094-b0d2-8d0940bb9ceb service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6924a88e-10c1-4073-a41c-88aad14ebd0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0933542 Dec 20 05:58:20.673696 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-7a03dd86-ad37-4b0b-b96e-01125e23a8c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:20.675441 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-7a03dd86-ad37-4b0b-b96e-01125e23a8c1 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 1097 time: 0.0434074 Dec 20 05:58:20.698698 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-eb19fb7b-6e87-4203-a291-3e541e1a860d req-d56d74ec-c95d-48bf-a638-e54398d02a50 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:20.731767 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-8ac79fb0-3188-4b6b-afa6-39251f6a9a24 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2 HTTP/1.1" status: 200 len: 217 time: 0.0378711 Dec 20 05:58:20.744819 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['ba178573-06ff-41da-95d0-ecc4c7c453b9'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:58:20.758163 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d56d74ec-c95d-48bf-a638-e54398d02a50 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Pushing event deleted for resources: {'Port': ['ID=ba178573-06ff-41da-95d0-ecc4c7c453b9,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:20.803016 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-f55f4ffc-124a-4373-a456-028192547795 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:20.804651 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-f55f4ffc-124a-4373-a456-028192547795 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4b218758-bd28-403f-ac97-d980db9b78c8 HTTP/1.1" status: 200 len: 855 time: 0.0647540 Dec 20 05:58:20.804870 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-eb19fb7b-6e87-4203-a291-3e541e1a860d req-d56d74ec-c95d-48bf-a638-e54398d02a50 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] No DVR routers for this DVR port ba178573-06ff-41da-95d0-ecc4c7c453b9 on host hv-cinder-82227 {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 05:58:20.808317 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-eb19fb7b-6e87-4203-a291-3e541e1a860d req-d56d74ec-c95d-48bf-a638-e54398d02a50 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:20.811564 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-eb19fb7b-6e87-4203-a291-3e541e1a860d req-d56d74ec-c95d-48bf-a638-e54398d02a50 tempest-VolumesSnapshotTestJSON-624548261 tempest-VolumesSnapshotTestJSON-624548261-project] 10.222.0.54 "DELETE /v2.0/ports/ba178573-06ff-41da-95d0-ecc4c7c453b9 HTTP/1.1" status: 204 len: 173 time: 0.6968305 Dec 20 05:58:20.827183 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-489860c6-abbd-4349-8ff0-d9ad68b41cda req-ba750f5b-cd3b-42dc-a740-ae9df79d9b94 service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1618118 Dec 20 05:58:20.852090 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-7fb2e029-b2d5-4663-bf90-7b940362d664 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:20.853671 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-7fb2e029-b2d5-4663-bf90-7b940362d664 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6623d855-6648-40fd-8a49-9c323edbff11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0412126 Dec 20 05:58:20.949617 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-489860c6-abbd-4349-8ff0-d9ad68b41cda req-bf34ddc3-9f52-4a68-9836-97810475cb25 service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1013536 Dec 20 05:58:21.032849 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-aeebe5ab-fed0-407f-9a4f-fd9cc0d90f65 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1712031 Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.057549 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.060351 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.060351 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.060351 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.060351 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.060351 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.060351 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.060351 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.060351 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.060351 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.060351 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.060351 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:21.060351 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:21.061874 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2be1326f-9029-4f73-a2f1-2e1b62cdbb3b req-116211f3-8aaf-4a8c-979a-cbaa373901a2 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:21.063285 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2be1326f-9029-4f73-a2f1-2e1b62cdbb3b req-116211f3-8aaf-4a8c-979a-cbaa373901a2 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.1096787 Dec 20 05:58:21.089546 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bf9f5cf-824a-40e6-a9db-49ecd3b2f175 req-e7c69a15-a07f-4b72-8fb9-a4a19bf5012e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:21.090955 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6bf9f5cf-824a-40e6-a9db-49ecd3b2f175 req-e7c69a15-a07f-4b72-8fb9-a4a19bf5012e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 943 time: 0.1360211 Dec 20 05:58:21.200972 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2be1326f-9029-4f73-a2f1-2e1b62cdbb3b req-665008d6-6f9f-48c8-811e-d9ff06e3e1ca tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1253533 Dec 20 05:58:21.213520 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6bf9f5cf-824a-40e6-a9db-49ecd3b2f175 req-bd9736fe-0cbd-446d-b6d0-eb3e1bacc4d4 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1156995 Dec 20 05:58:21.218494 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08898e63-7399-4eb5-86e8-1a6a15db27f9 req-30bbf385-85eb-4638-bf76-00bf12ae6163 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1744511 Dec 20 05:58:21.396339 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fded32a-209f-416f-81ac-da24a5add543 req-b0129bc7-e30a-43e4-ae24-22a988ee6e97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:21.398034 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fded32a-209f-416f-81ac-da24a5add543 req-b0129bc7-e30a-43e4-ae24-22a988ee6e97 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 1097 time: 0.0422804 Dec 20 05:58:21.455221 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd63d89bf-797a-4e53-b11e-6dd04664529f', 'name': 'network-vif-deleted', 'tag': 'ba178573-06ff-41da-95d0-ecc4c7c453b9'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:58:21.457502 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-59ce77cd-24f3-4707-a73e-4b4a329af442" -d '{"events": [{"server_uuid": "d63d89bf-797a-4e53-b11e-6dd04664529f", "name": "network-vif-deleted", "tag": "ba178573-06ff-41da-95d0-ecc4c7c453b9"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:58:21.502501 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fded32a-209f-416f-81ac-da24a5add543 req-cde0f75d-f8dd-4485-9638-6e8b0f9cf219 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:21.504156 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fded32a-209f-416f-81ac-da24a5add543 req-cde0f75d-f8dd-4485-9638-6e8b0f9cf219 service neutron] 10.222.0.54 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 917 time: 0.0959535 Dec 20 05:58:21.505142 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:58:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c2aa26b5-1ac7-4a71-bff4-0ddc4a24c9e4 x-openstack-request-id: req-c2aa26b5-1ac7-4a71-bff4-0ddc4a24c9e4 {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:58:21.505440 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d63d89bf-797a-4e53-b11e-6dd04664529f", "name": "network-vif-deleted", "tag": "ba178573-06ff-41da-95d0-ecc4c7c453b9", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:58:21.505692 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-c2aa26b5-1ac7-4a71-bff4-0ddc4a24c9e4 {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:58:21.506096 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd63d89bf-797a-4e53-b11e-6dd04664529f', 'name': 'network-vif-deleted', 'tag': 'ba178573-06ff-41da-95d0-ecc4c7c453b9', 'status': 'completed', 'code': 200} Dec 20 05:58:21.560310 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fded32a-209f-416f-81ac-da24a5add543 req-658d81ec-9a27-4252-8bbb-f09744f133f1 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2 HTTP/1.1" status: 200 len: 217 time: 0.0357611 Dec 20 05:58:21.618570 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fded32a-209f-416f-81ac-da24a5add543 req-1d280605-4a94-40a5-95d4-fefca9d42c44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:21.620077 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fded32a-209f-416f-81ac-da24a5add543 req-1d280605-4a94-40a5-95d4-fefca9d42c44 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4b218758-bd28-403f-ac97-d980db9b78c8 HTTP/1.1" status: 200 len: 855 time: 0.0508158 Dec 20 05:58:21.667879 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fded32a-209f-416f-81ac-da24a5add543 req-a204a852-7a84-45e8-8c20-983317a3b7cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:21.669367 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fded32a-209f-416f-81ac-da24a5add543 req-a204a852-7a84-45e8-8c20-983317a3b7cc service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6623d855-6648-40fd-8a49-9c323edbff11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0421567 Dec 20 05:58:21.771662 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fded32a-209f-416f-81ac-da24a5add543 req-caf9fa5f-5e66-4152-b721-8c28019a0d20 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0908051 Dec 20 05:58:21.871952 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fded32a-209f-416f-81ac-da24a5add543 req-901d9c0c-5011-4f94-9488-4c73a2ea9054 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0927699 Dec 20 05:58:22.345795 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09341616-60f5-4a3c-87e0-fb369f99406c req-33607292-469d-4057-a160-182079d36473 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:22.347256 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-09341616-60f5-4a3c-87e0-fb369f99406c req-33607292-469d-4057-a160-182079d36473 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0737562 Dec 20 05:58:22.354969 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35fec381-0efb-4351-9dae-7fd9bd93d72f req-c00be55a-a301-4fbd-8d01-dd10ac2738dd tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:22.356335 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-35fec381-0efb-4351-9dae-7fd9bd93d72f req-c00be55a-a301-4fbd-8d01-dd10ac2738dd tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 943 time: 0.0741916 Dec 20 05:58:22.426211 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-09341616-60f5-4a3c-87e0-fb369f99406c req-ba18df71-afff-454e-b84c-ab7b8137d308 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0689578 Dec 20 05:58:22.433645 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-35fec381-0efb-4351-9dae-7fd9bd93d72f req-347048e3-3dc4-45bf-b06b-81ec5e947fc1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0710120 Dec 20 05:58:23.578335 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be0e168b-a413-4f79-b9f3-8041c79c94d9 req-b7905fa5-a92a-4176-89a7-29279770575f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:23.580093 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-be0e168b-a413-4f79-b9f3-8041c79c94d9 req-b7905fa5-a92a-4176-89a7-29279770575f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0730419 Dec 20 05:58:23.588110 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8950c7e4-f491-4118-bcbb-b99c600edf6e req-d6746dd5-cbb1-418e-9bcc-ecf1a9c269b7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:23.589473 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8950c7e4-f491-4118-bcbb-b99c600edf6e req-d6746dd5-cbb1-418e-9bcc-ecf1a9c269b7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 943 time: 0.0842814 Dec 20 05:58:23.658881 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-be0e168b-a413-4f79-b9f3-8041c79c94d9 req-5cb945c8-29e7-415a-9d0e-fc893b20517e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0683932 Dec 20 05:58:23.662232 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8950c7e4-f491-4118-bcbb-b99c600edf6e req-21ced23b-527b-422d-9d73-3fcb4c109166 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0663910 Dec 20 05:58:24.782818 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690d80f6-d776-4c45-b159-8d3335901c1d req-20ef900e-796c-4151-81d1-9c085100194d tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:24.784351 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-690d80f6-d776-4c45-b159-8d3335901c1d req-20ef900e-796c-4151-81d1-9c085100194d tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 943 time: 0.0544574 Dec 20 05:58:24.859741 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6414ad88-7063-4dc4-a7a8-84d3368caad4 req-4debe5d4-2d99-4963-a1c4-691f8dcb5e7f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:24.861255 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6414ad88-7063-4dc4-a7a8-84d3368caad4 req-4debe5d4-2d99-4963-a1c4-691f8dcb5e7f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.1325047 Dec 20 05:58:24.864643 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-690d80f6-d776-4c45-b159-8d3335901c1d req-4df15585-c840-47fd-96c9-e33c2cc142e0 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0703347 Dec 20 05:58:24.909961 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6414ad88-7063-4dc4-a7a8-84d3368caad4 req-37eed0dd-d93a-4694-9077-e9aae6e1d0a6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427601 Dec 20 05:58:24.942130 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 9e825da9-eb60-4572-8a89-92caa8cddaa2 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:58:25.043858 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 9e825da9-eb60-4572-8a89-92caa8cddaa2, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:25.054847 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'port_id': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'mac_address': 'fa:16:3e:0a:87:10', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 414, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:58:25.071931 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826fca5c-2bef-4a38-8b1d-5071e12bac47 req-69d2db0d-bfb8-44c9-a3c8-b1b9ed00634d tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:25.073417 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-826fca5c-2bef-4a38-8b1d-5071e12bac47 req-69d2db0d-bfb8-44c9-a3c8-b1b9ed00634d tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.0533161 Dec 20 05:58:25.096019 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:25.108490 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9e825da9-eb60-4572-8a89-92caa8cddaa2 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:58:25.127563 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 9e825da9-eb60-4572-8a89-92caa8cddaa2, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:25.131565 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:25.132704 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 99279753-6934-4d6f-88dc-e3785468af1d details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:58:25.134230 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-826fca5c-2bef-4a38-8b1d-5071e12bac47 req-894cd495-90ca-4d17-aba2-84c06a23d74b tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0543523 Dec 20 05:58:25.204123 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=9e825da9-eb60-4572-8a89-92caa8cddaa2,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:25.214756 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:25.215127 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:25.215486 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:25.215847 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:25.216177 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:25.216501 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:25.216825 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:25.217147 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:25.217467 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:25.217788 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:25.218103 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:25.218418 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:25.218732 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:25.276839 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 99279753-6934-4d6f-88dc-e3785468af1d, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=99279753-6934-4d6f-88dc-e3785468af1d,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:25.287697 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '99279753-6934-4d6f-88dc-e3785468af1d', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'port_id': '99279753-6934-4d6f-88dc-e3785468af1d', 'mac_address': 'fa:16:3e:03:38:60', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 449, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:58:25.323950 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:25.336441 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 99279753-6934-4d6f-88dc-e3785468af1d {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:58:25.354601 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 99279753-6934-4d6f-88dc-e3785468af1d, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=99279753-6934-4d6f-88dc-e3785468af1d,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:25.358538 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:25.405878 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=99279753-6934-4d6f-88dc-e3785468af1d,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:25.933115 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device ba178573-06ff-41da-95d0-ecc4c7c453b9 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:58:25.960540 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: ba178573-06ff-41da-95d0-ecc4c7c453b9 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:58:25.961636 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device ba178573-06ff-41da-95d0-ecc4c7c453b9 not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:58:25.985753 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986cf282-8b40-49bc-889c-696336df4a0a req-5db1165f-723f-4818-b721-f01647237dca tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:25.987258 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-986cf282-8b40-49bc-889c-696336df4a0a req-5db1165f-723f-4818-b721-f01647237dca tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 944 time: 0.0545161 Dec 20 05:58:26.096118 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a35e148-64dc-4c44-a084-7bb4fe2ef4dd req-33c26498-1797-4362-bbd4-93be65289831 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:26.097577 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0a35e148-64dc-4c44-a084-7bb4fe2ef4dd req-33c26498-1797-4362-bbd4-93be65289831 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 945 time: 0.1093502 Dec 20 05:58:26.100639 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-986cf282-8b40-49bc-889c-696336df4a0a req-dbc894cd-2da8-4ff3-9436-e09167f219b8 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0967000 Dec 20 05:58:26.103703 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ac8e65-a4b5-4202-9ea6-4b18d445f6dc req-edc40b40-c036-48c2-a0b9-24087363cb7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:26.105039 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-92ac8e65-a4b5-4202-9ea6-4b18d445f6dc req-edc40b40-c036-48c2-a0b9-24087363cb7b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=627c52664e194163a380283ded298eb5&device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 1137 time: 0.1089892 Dec 20 05:58:26.200014 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0a35e148-64dc-4c44-a084-7bb4fe2ef4dd req-8dcb45e7-0808-4dfc-b1d2-c8db76aed801 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0939324 Dec 20 05:58:26.228634 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ac8e65-a4b5-4202-9ea6-4b18d445f6dc req-491b53fc-a33a-4972-b93a-dece134307b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:26.230090 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-92ac8e65-a4b5-4202-9ea6-4b18d445f6dc req-491b53fc-a33a-4972-b93a-dece134307b6 service neutron] 10.222.0.54 "GET /v2.0/networks?id=4e35b188-ad5c-4cae-9209-b7e538e3669f HTTP/1.1" status: 200 len: 916 time: 0.1178403 Dec 20 05:58:26.331484 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-92ac8e65-a4b5-4202-9ea6-4b18d445f6dc req-2c378ad0-f637-4f80-bb90-d1b0e2fd8f9f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=18320379-21ed-4b2e-af2c-62b95cf39325 HTTP/1.1" status: 200 len: 1000 time: 0.0884106 Dec 20 05:58:26.350359 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['9e825da9-eb60-4572-8a89-92caa8cddaa2'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:58:26.354909 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac844ab-5303-43e7-a40d-8424321c088b req-7139458b-252a-44d4-b39d-3b9ebafb3b71 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:26.356368 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9ac844ab-5303-43e7-a40d-8424321c088b req-7139458b-252a-44d4-b39d-3b9ebafb3b71 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.1521335 Dec 20 05:58:26.389065 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['99279753-6934-4d6f-88dc-e3785468af1d'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:58:26.419773 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ac8e65-a4b5-4202-9ea6-4b18d445f6dc req-14039e59-191b-4467-855c-fe4c3a601098 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:26.421245 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-92ac8e65-a4b5-4202-9ea6-4b18d445f6dc req-14039e59-191b-4467-855c-fe4c3a601098 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fca5c9c5-06df-4c64-840c-e8558a30dd3c HTTP/1.1" status: 200 len: 854 time: 0.0819588 Dec 20 05:58:26.466658 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9ac844ab-5303-43e7-a40d-8424321c088b req-84951284-6412-4a4c-b466-ed56c90c7f96 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0930648 Dec 20 05:58:26.485271 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ac8e65-a4b5-4202-9ea6-4b18d445f6dc req-163ca215-9b6f-4e1d-9eaf-0a414113d25e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:26.486743 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-92ac8e65-a4b5-4202-9ea6-4b18d445f6dc req-163ca215-9b6f-4e1d-9eaf-0a414113d25e service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4e35b188-ad5c-4cae-9209-b7e538e3669f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0562205 Dec 20 05:58:26.575435 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-92ac8e65-a4b5-4202-9ea6-4b18d445f6dc req-7880e104-4b21-48b4-91b2-5c64701bfd3a service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0807266 Dec 20 05:58:26.668024 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-92ac8e65-a4b5-4202-9ea6-4b18d445f6dc req-f9de57c7-26b9-402f-b392-592e90158972 service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842025 Dec 20 05:58:27.213771 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abc0190c-46a9-4c55-9840-09f89f9d0db7 req-d4478e00-57aa-40c2-9a18-4de8dab2521c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:27.215241 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-abc0190c-46a9-4c55-9840-09f89f9d0db7 req-d4478e00-57aa-40c2-9a18-4de8dab2521c tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 944 time: 0.0487280 Dec 20 05:58:27.275782 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-abc0190c-46a9-4c55-9840-09f89f9d0db7 req-1121a82f-58a1-4b8e-8c63-dd2742c3d2a4 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0514934 Dec 20 05:58:27.327459 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-996c5700-2bed-4777-8b45-d05cf13ec3a5 req-de078768-46a3-4b40-a5b8-261da87c56a4 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:27.335280 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-996c5700-2bed-4777-8b45-d05cf13ec3a5 req-de078768-46a3-4b40-a5b8-261da87c56a4 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 945 time: 0.0584779 Dec 20 05:58:27.387368 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-996c5700-2bed-4777-8b45-d05cf13ec3a5 req-c5a4c34d-00cb-4d26-8ebf-bf2c00672794 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0511498 Dec 20 05:58:27.580237 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-493b438d-f83b-49a9-80a2-39d71653803e req-f784bab8-1f1c-4797-adfe-c05c6b2b72d8 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:27.581608 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-493b438d-f83b-49a9-80a2-39d71653803e req-f784bab8-1f1c-4797-adfe-c05c6b2b72d8 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.0476851 Dec 20 05:58:27.643563 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-493b438d-f83b-49a9-80a2-39d71653803e req-070d19df-6e3b-4b18-b752-408dd0aabc4b tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0533924 Dec 20 05:58:27.993707 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 9e825da9-eb60-4572-8a89-92caa8cddaa2 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:28.041342 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port 9e825da9-eb60-4572-8a89-92caa8cddaa2 completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 05:58:28.044829 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 9e825da9-eb60-4572-8a89-92caa8cddaa2 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:28.045198 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:28.124286 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:28.146678 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e825da9-eb60-4572-8a89-92caa8cddaa2'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:58:28.149500 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bba9cb6b-3ad0-477d-a2b4-438523ad25d1" -d '{"events": [{"server_uuid": "8e0ee236-8474-4f2a-b875-752d3dec628f", "name": "network-vif-plugged", "status": "completed", "tag": "9e825da9-eb60-4572-8a89-92caa8cddaa2"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:58:28.162817 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 9e825da9-eb60-4572-8a89-92caa8cddaa2, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:28.167278 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:28.168144 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 99279753-6934-4d6f-88dc-e3785468af1d up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:28.191501 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:58:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d97907bb-fba3-47a4-956c-30e6cd06ba3d x-openstack-request-id: req-d97907bb-fba3-47a4-956c-30e6cd06ba3d {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:58:28.191832 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8e0ee236-8474-4f2a-b875-752d3dec628f", "name": "network-vif-plugged", "status": "completed", "tag": "9e825da9-eb60-4572-8a89-92caa8cddaa2", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:58:28.192086 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-d97907bb-fba3-47a4-956c-30e6cd06ba3d {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:58:28.192475 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'code': 200} Dec 20 05:58:28.249857 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=9e825da9-eb60-4572-8a89-92caa8cddaa2,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:28.261821 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port 99279753-6934-4d6f-88dc-e3785468af1d completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 05:58:28.265667 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 99279753-6934-4d6f-88dc-e3785468af1d triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:28.266202 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:28.349894 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:28.384005 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 99279753-6934-4d6f-88dc-e3785468af1d, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=99279753-6934-4d6f-88dc-e3785468af1d,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:28.390710 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:28.448528 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=99279753-6934-4d6f-88dc-e3785468af1d,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:28.661027 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d55b3fc-255f-4cc2-a689-b846f26bde09 req-e6c1eb9c-e5a2-42d5-b43f-1254f52370be tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:28.662391 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5d55b3fc-255f-4cc2-a689-b846f26bde09 req-e6c1eb9c-e5a2-42d5-b43f-1254f52370be tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 944 time: 0.3218086 Dec 20 05:58:28.692379 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84aea1e1-cbae-49bc-ad31-a4a6c10f353a req-07a25b75-7104-4229-bd97-1f7f9f01a805 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:28.693798 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-84aea1e1-cbae-49bc-ad31-a4a6c10f353a req-07a25b75-7104-4229-bd97-1f7f9f01a805 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 1099 time: 0.3290067 Dec 20 05:58:28.720223 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea8c89c6-0f4d-4e71-810b-2c1ba0d8f654 req-9b1d89c7-5106-4f9e-a76e-7990dc27a018 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:28.721601 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ea8c89c6-0f4d-4e71-810b-2c1ba0d8f654 req-9b1d89c7-5106-4f9e-a76e-7990dc27a018 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0989616 Dec 20 05:58:28.770512 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5d55b3fc-255f-4cc2-a689-b846f26bde09 req-9e0b26bf-2f58-4625-b60c-9e5422418de8 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1006327 Dec 20 05:58:28.805827 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-84aea1e1-cbae-49bc-ad31-a4a6c10f353a req-1c303ec7-fbe1-493e-8b23-017316ff9879 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1016936 Dec 20 05:58:28.817613 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ea8c89c6-0f4d-4e71-810b-2c1ba0d8f654 req-d89f58a3-182c-477b-910f-0935990c39cf tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0870979 Dec 20 05:58:28.883757 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81cffe2a-952f-409b-be47-613412c90ce0 req-52e4c87f-89c3-4db0-b4a4-e5098eda3d5c tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:28.885326 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81cffe2a-952f-409b-be47-613412c90ce0 req-52e4c87f-89c3-4db0-b4a4-e5098eda3d5c tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.0496423 Dec 20 05:58:28.943544 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81cffe2a-952f-409b-be47-613412c90ce0 req-fbaeeb4e-0947-4621-8abc-af49447ac8db tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0519905 Dec 20 05:58:29.920399 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f22194d-bfda-43d3-b338-3190c17746fd req-0911b74d-c56f-4333-9ff5-e7764d274a10 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:29.921859 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2f22194d-bfda-43d3-b338-3190c17746fd req-0911b74d-c56f-4333-9ff5-e7764d274a10 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 945 time: 0.0653682 Dec 20 05:58:29.997384 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a35844fe-a1f4-47d1-914e-74e4bf08d068 req-c21e1059-a3ac-443f-92bc-9762095b2d45 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:29.998858 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a35844fe-a1f4-47d1-914e-74e4bf08d068 req-c21e1059-a3ac-443f-92bc-9762095b2d45 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0761354 Dec 20 05:58:30.006296 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2f22194d-bfda-43d3-b338-3190c17746fd req-118e4e38-08b4-4164-9322-89aaed5ef876 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0739102 Dec 20 05:58:30.051622 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a35844fe-a1f4-47d1-914e-74e4bf08d068 req-6697bb10-8062-4fee-be9d-158c41fc6303 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443637 Dec 20 05:58:30.116004 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e25d20c2-1a54-4aa5-bc2c-289461131239 req-a4568636-8146-47bf-8906-9973a1ce5c93 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:30.118090 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e25d20c2-1a54-4aa5-bc2c-289461131239 req-a4568636-8146-47bf-8906-9973a1ce5c93 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.0518086 Dec 20 05:58:30.178829 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e25d20c2-1a54-4aa5-bc2c-289461131239 req-30b89cc4-fdd1-4e9b-a25b-b68d14118994 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0545449 Dec 20 05:58:30.194049 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0b14fdd5-af46-4268-a3b8-06d9f0a9196b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99279753-6934-4d6f-88dc-e3785468af1d'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:58:30.196536 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-61fb4264-30a2-4966-b8ba-3e12dd69c3c9" -d '{"events": [{"server_uuid": "0b14fdd5-af46-4268-a3b8-06d9f0a9196b", "name": "network-vif-plugged", "status": "completed", "tag": "99279753-6934-4d6f-88dc-e3785468af1d"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:58:30.231697 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:58:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54bd5225-b2c4-4c4a-a7a1-9f9d6b3a335f x-openstack-request-id: req-54bd5225-b2c4-4c4a-a7a1-9f9d6b3a335f {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:58:30.231994 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0b14fdd5-af46-4268-a3b8-06d9f0a9196b", "name": "network-vif-plugged", "status": "completed", "tag": "99279753-6934-4d6f-88dc-e3785468af1d", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:58:30.232250 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-54bd5225-b2c4-4c4a-a7a1-9f9d6b3a335f {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:58:30.232658 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0b14fdd5-af46-4268-a3b8-06d9f0a9196b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99279753-6934-4d6f-88dc-e3785468af1d', 'code': 200} Dec 20 05:58:30.446301 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8d3de94-151a-40f9-a7dc-3b62afc20262 req-febf3538-dcc4-477e-acde-afea5ab131a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:30.447673 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e8d3de94-151a-40f9-a7dc-3b62afc20262 req-febf3538-dcc4-477e-acde-afea5ab131a0 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 1098 time: 0.0385230 Dec 20 05:58:30.494371 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e8d3de94-151a-40f9-a7dc-3b62afc20262 req-db50e02a-d5e3-4f72-95c3-d0efda1f892d service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392120 Dec 20 05:58:31.125123 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11dc8df0-daed-4f5c-9151-b7f904d8c039 req-57460cfe-51c0-41ab-9429-e5de69a79fc3 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:31.126525 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-11dc8df0-daed-4f5c-9151-b7f904d8c039 req-57460cfe-51c0-41ab-9429-e5de69a79fc3 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 945 time: 0.0484021 Dec 20 05:58:31.218691 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-787f9866-e618-4fbf-99c0-d68a62b2cf43 req-28af8b9d-65bd-4ff4-ab79-a99a9605fc03 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:31.220257 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-787f9866-e618-4fbf-99c0-d68a62b2cf43 req-28af8b9d-65bd-4ff4-ab79-a99a9605fc03 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0928211 Dec 20 05:58:31.223991 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-11dc8df0-daed-4f5c-9151-b7f904d8c039 req-679062d5-3118-4d4d-8000-a0e98356cdbb tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0882137 Dec 20 05:58:31.267477 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-787f9866-e618-4fbf-99c0-d68a62b2cf43 req-d683dfd6-d594-4d19-80f7-c2f9aebbd78a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413916 Dec 20 05:58:31.333069 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-703a12e2-477f-431b-a506-4a5fa5e8e223 req-0398c7ff-133a-4c15-b0b6-d0488f7739c5 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:31.334574 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-703a12e2-477f-431b-a506-4a5fa5e8e223 req-0398c7ff-133a-4c15-b0b6-d0488f7739c5 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.0527096 Dec 20 05:58:31.409476 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16c4b10e-d8e3-40f1-a7a9-5f6f67098ea4 req-b3dfcf11-db51-45f9-b625-07fe12cc6139 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:31.410972 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-16c4b10e-d8e3-40f1-a7a9-5f6f67098ea4 req-b3dfcf11-db51-45f9-b625-07fe12cc6139 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0755389 Dec 20 05:58:31.419856 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48062) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:31.424390 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-582e94ab-e13f-47f9-8db3-5969b9f7a56d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Request body: {'floatingip': {'port_id': '9e825da9-eb60-4572-8a89-92caa8cddaa2'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:31.425705 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-703a12e2-477f-431b-a506-4a5fa5e8e223 req-a6e53a2a-3517-4765-95ac-78d42b0f9cf9 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0824814 Dec 20 05:58:31.466583 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-582e94ab-e13f-47f9-8db3-5969b9f7a56d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for floatingip, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:31.713681 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-6f952e61-6d18-4be0-b755-699be5535238 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:32.243939 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-582e94ab-e13f-47f9-8db3-5969b9f7a56d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:32.247892 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-582e94ab-e13f-47f9-8db3-5969b9f7a56d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:32.346437 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.l3_db [None req-582e94ab-e13f-47f9-8db3-5969b9f7a56d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Floating IP d251a20f-2a53-4fc5-b509-337fee6938ef associated. External IP: 172.27.3.15, port: 9e825da9-eb60-4572-8a89-92caa8cddaa2. Dec 20 05:58:32.396197 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-423b9a83-2509-49ae-b446-39b0758db3f4 req-97d572ae-aa3c-41fc-a11d-37169af168d9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:32.397720 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-423b9a83-2509-49ae-b446-39b0758db3f4 req-97d572ae-aa3c-41fc-a11d-37169af168d9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 945 time: 0.0535622 Dec 20 05:58:32.448936 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-423b9a83-2509-49ae-b446-39b0758db3f4 req-7750f48e-7b10-4731-a5f8-1743ad26dcf1 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432217 Dec 20 05:58:32.546159 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd14d072-8d34-48c0-a94c-7fee4fbf6351 req-3bfee1bc-212c-4ccf-a33b-078de788f0f4 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:32.548199 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dd14d072-8d34-48c0-a94c-7fee4fbf6351 req-3bfee1bc-212c-4ccf-a33b-078de788f0f4 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.0528102 Dec 20 05:58:32.559243 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-582e94ab-e13f-47f9-8db3-5969b9f7a56d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Router c3741b68-c75b-409c-9c20-6d6808f6e838 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:58:32.608187 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dd14d072-8d34-48c0-a94c-7fee4fbf6351 req-0d4a185f-d405-4895-8928-73257ae23dc4 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0539629 Dec 20 05:58:32.666956 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-582e94ab-e13f-47f9-8db3-5969b9f7a56d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:58:32.671859 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-582e94ab-e13f-47f9-8db3-5969b9f7a56d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:32.676384 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b8cb708-4bc0-4680-992c-7e33f826b584 None None] Sync routers for ids ['c3741b68-c75b-409c-9c20-6d6808f6e838'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:58:32.686763 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b8cb708-4bc0-4680-992c-7e33f826b584 None None] Routers {'c3741b68-c75b-409c-9c20-6d6808f6e838'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:32.687391 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-4b8cb708-4bc0-4680-992c-7e33f826b584 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['c3741b68-c75b-409c-9c20-6d6808f6e838'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:32.700383 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-582e94ab-e13f-47f9-8db3-5969b9f7a56d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "PUT /v2.0/floatingips/d251a20f-2a53-4fc5-b509-337fee6938ef HTTP/1.1" status: 200 len: 991 time: 1.2794490 Dec 20 05:58:32.700986 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'tag': '9e825da9-eb60-4572-8a89-92caa8cddaa2'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:58:32.703217 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-89302b21-1bfa-4dd6-a785-31d33a96787e" -d '{"events": [{"name": "network-changed", "server_uuid": "8e0ee236-8474-4f2a-b875-752d3dec628f", "tag": "9e825da9-eb60-4572-8a89-92caa8cddaa2"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:58:32.739075 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:58:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-14eac51d-3557-4b31-b901-91abad87be2c x-openstack-request-id: req-14eac51d-3557-4b31-b901-91abad87be2c {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:58:32.739691 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8e0ee236-8474-4f2a-b875-752d3dec628f", "tag": "9e825da9-eb60-4572-8a89-92caa8cddaa2", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:58:32.739691 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-14eac51d-3557-4b31-b901-91abad87be2c {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:58:32.740050 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'tag': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'status': 'completed', 'code': 200} Dec 20 05:58:32.909458 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-4b8cb708-4bc0-4680-992c-7e33f826b584 None None] Set router c3741b68-c75b-409c-9c20-6d6808f6e838 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:33.174171 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-4b8cb708-4bc0-4680-992c-7e33f826b584 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': 'd251a20f-2a53-4fc5-b509-337fee6938ef', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'floating_ip_address': '172.27.3.15', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'port_id': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 538, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'mac_address': 'fa:16:3e:0a:87:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:58:15Z', 'updated_at': '2021-12-20T05:58:32Z', 'revision_number': 1, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:17Z', 'revision_number': 5, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:33.200461 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b8cb708-4bc0-4680-992c-7e33f826b584 None None] Checking router: c3741b68-c75b-409c-9c20-6d6808f6e838 for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:58:33.208748 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b8cb708-4bc0-4680-992c-7e33f826b584 None None] Routers {'c3741b68-c75b-409c-9c20-6d6808f6e838'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:33.209335 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-4b8cb708-4bc0-4680-992c-7e33f826b584 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['c3741b68-c75b-409c-9c20-6d6808f6e838'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:33.314044 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-4b8cb708-4bc0-4680-992c-7e33f826b584 None None] Set router c3741b68-c75b-409c-9c20-6d6808f6e838 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:33.534207 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-4b8cb708-4bc0-4680-992c-7e33f826b584 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': 'd251a20f-2a53-4fc5-b509-337fee6938ef', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'floating_ip_address': '172.27.3.15', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'port_id': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 538, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'mac_address': 'fa:16:3e:0a:87:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:58:15Z', 'updated_at': '2021-12-20T05:58:32Z', 'revision_number': 1, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:17Z', 'revision_number': 5, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:33.560683 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b8cb708-4bc0-4680-992c-7e33f826b584 None None] The sync data for ids ['c3741b68-c75b-409c-9c20-6d6808f6e838'] in dv-cinder-822278-1-iscsi is: [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': 'd251a20f-2a53-4fc5-b509-337fee6938ef', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'floating_ip_address': '172.27.3.15', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'port_id': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 538, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'mac_address': 'fa:16:3e:0a:87:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:58:15Z', 'updated_at': '2021-12-20T05:58:32Z', 'revision_number': 1, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:17Z', 'revision_number': 5, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:58:33.563537 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-531e2141-ea58-439c-a0bb-b52584e82a56 req-9c14819c-a7be-40cf-9e56-7e1bd956af0f tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:33.565030 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-531e2141-ea58-439c-a0bb-b52584e82a56 req-9c14819c-a7be-40cf-9e56-7e1bd956af0f tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 945 time: 0.0480509 Dec 20 05:58:33.615724 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-531e2141-ea58-439c-a0bb-b52584e82a56 req-8e0636cd-a8e5-4757-bbae-91d12f389f82 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442622 Dec 20 05:58:33.734076 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-580dcc4c-ecb1-43e2-b410-6763a111adae req-ef74f49a-d480-4734-8ddd-d99da740eda2 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:33.735586 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-580dcc4c-ecb1-43e2-b410-6763a111adae req-ef74f49a-d480-4734-8ddd-d99da740eda2 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.0566609 Dec 20 05:58:33.757264 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a77a8290-3746-4b5c-8d0a-1115c717fdfe None None] New status for floating IP d251a20f-2a53-4fc5-b509-337fee6938ef: ACTIVE {{(pid=102448) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 05:58:33.797980 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-580dcc4c-ecb1-43e2-b410-6763a111adae req-4f985f0b-df72-4e46-8ea2-63ca6a437a2d tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0560887 Dec 20 05:58:34.157721 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-7b373c84-ba6e-4cbc-891a-9420220905f1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:34.349587 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89302b21-1bfa-4dd6-a785-31d33a96787e req-3204162b-e96c-45b4-98f5-841421fc66a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:34.351058 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-89302b21-1bfa-4dd6-a785-31d33a96787e req-3204162b-e96c-45b4-98f5-841421fc66a5 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 1099 time: 0.0393951 Dec 20 05:58:34.446951 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89302b21-1bfa-4dd6-a785-31d33a96787e req-ca39dff3-fe80-4731-97c8-a2fe52dca909 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:34.448484 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-89302b21-1bfa-4dd6-a785-31d33a96787e req-ca39dff3-fe80-4731-97c8-a2fe52dca909 service neutron] 10.222.0.54 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 917 time: 0.0889847 Dec 20 05:58:34.555063 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-89302b21-1bfa-4dd6-a785-31d33a96787e req-6af09603-27fe-4fc1-aa2a-96d42311f131 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2 HTTP/1.1" status: 200 len: 1001 time: 0.0586658 Dec 20 05:58:34.660450 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89302b21-1bfa-4dd6-a785-31d33a96787e req-145c99d5-bcd2-4c77-a7fa-f1c708ded387 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:34.661987 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-89302b21-1bfa-4dd6-a785-31d33a96787e req-145c99d5-bcd2-4c77-a7fa-f1c708ded387 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4b218758-bd28-403f-ac97-d980db9b78c8 HTTP/1.1" status: 200 len: 855 time: 0.0508678 Dec 20 05:58:34.742634 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89302b21-1bfa-4dd6-a785-31d33a96787e req-be1dc26e-9333-41da-b677-289214b49f7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:34.744140 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-89302b21-1bfa-4dd6-a785-31d33a96787e req-be1dc26e-9333-41da-b677-289214b49f7f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6623d855-6648-40fd-8a49-9c323edbff11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0720575 Dec 20 05:58:34.757895 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eb528dd-e4b9-4255-bcba-2fdda02aa405 req-4240e04d-0a8c-41c4-9a9b-260f8c76e13e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:34.759247 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7eb528dd-e4b9-4255-bcba-2fdda02aa405 req-4240e04d-0a8c-41c4-9a9b-260f8c76e13e tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 945 time: 0.0596352 Dec 20 05:58:34.862248 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7eb528dd-e4b9-4255-bcba-2fdda02aa405 req-bff2f647-40bb-4171-a1bb-5e57b551c674 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0953789 Dec 20 05:58:34.885619 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-89302b21-1bfa-4dd6-a785-31d33a96787e req-32ea0bbd-ae24-4457-8314-2f030ad48e31 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1254425 Dec 20 05:58:34.976655 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6f9e3c-6316-469c-ace0-9cb6b59fc8c5 req-5194e8a9-d6a7-47a3-8f77-d77094c98f5f tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:34.978021 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bc6f9e3c-6316-469c-ace0-9cb6b59fc8c5 req-5194e8a9-d6a7-47a3-8f77-d77094c98f5f tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.1071758 Dec 20 05:58:34.989546 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:35.011167 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-89302b21-1bfa-4dd6-a785-31d33a96787e req-9d9a800f-f416-4e64-a4d7-f26e6d9d0ae1 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1119685 Dec 20 05:58:35.048671 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bc6f9e3c-6316-469c-ace0-9cb6b59fc8c5 req-15755942-698b-4fd0-bc7a-d316e17ade86 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0629182 Dec 20 05:58:35.977217 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279b5dc5-7f04-4d30-a579-191bfb318938 req-bf46b54a-5fc0-42f8-8ba0-1c2428d6d5e7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:35.978834 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-279b5dc5-7f04-4d30-a579-191bfb318938 req-bf46b54a-5fc0-42f8-8ba0-1c2428d6d5e7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 945 time: 0.0506988 Dec 20 05:58:36.026166 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-279b5dc5-7f04-4d30-a579-191bfb318938 req-3699360a-64f8-45e7-891b-2bbb7b2ceb04 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414109 Dec 20 05:58:36.175882 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7615c80d-6683-4967-a621-84d6db33233c req-7b386020-9fbe-4a5f-8646-9875d7e61e18 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:36.177344 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7615c80d-6683-4967-a621-84d6db33233c req-7b386020-9fbe-4a5f-8646-9875d7e61e18 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 945 time: 0.0807924 Dec 20 05:58:36.186271 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48104) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:36.188513 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1637613-cbcb-4e86-a508-4a9cbe645656 req-74d9fbb6-a3e2-47db-8907-f5bdf5c741b9 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:36.189921 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d1637613-cbcb-4e86-a508-4a9cbe645656 req-74d9fbb6-a3e2-47db-8907-f5bdf5c741b9 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.0689147 Dec 20 05:58:36.190840 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-ed5cf081-520e-45c6-b5af-4e59a3a528b7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Request body: {'floatingip': {'port_id': '99279753-6934-4d6f-88dc-e3785468af1d'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:36.231369 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ed5cf081-520e-45c6-b5af-4e59a3a528b7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for floatingip, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:36.250223 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d1637613-cbcb-4e86-a508-4a9cbe645656 req-e9f4d186-a1d4-42e8-b099-a09ebb627206 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0535777 Dec 20 05:58:36.482316 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:36.670633 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ed5cf081-520e-45c6-b5af-4e59a3a528b7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:36.674639 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ed5cf081-520e-45c6-b5af-4e59a3a528b7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:36.771038 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.l3_db [None req-ed5cf081-520e-45c6-b5af-4e59a3a528b7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Floating IP 1fe55298-6d1d-4aae-b449-b53519d7ed2c associated. External IP: 172.27.3.17, port: 99279753-6934-4d6f-88dc-e3785468af1d. Dec 20 05:58:36.979084 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ed5cf081-520e-45c6-b5af-4e59a3a528b7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Router 3f858ad2-b10f-4f04-9727-f99638a01796 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:58:37.086216 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed5cf081-520e-45c6-b5af-4e59a3a528b7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:58:37.090812 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ed5cf081-520e-45c6-b5af-4e59a3a528b7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:37.095273 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c7476d7-867c-4db2-83cf-e1c22dba62cf None None] Sync routers for ids ['3f858ad2-b10f-4f04-9727-f99638a01796'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:58:37.105589 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c7476d7-867c-4db2-83cf-e1c22dba62cf None None] Routers {'3f858ad2-b10f-4f04-9727-f99638a01796'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:37.106198 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-1c7476d7-867c-4db2-83cf-e1c22dba62cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['3f858ad2-b10f-4f04-9727-f99638a01796'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:37.116201 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-ed5cf081-520e-45c6-b5af-4e59a3a528b7 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "PUT /v2.0/floatingips/1fe55298-6d1d-4aae-b449-b53519d7ed2c HTTP/1.1" status: 200 len: 990 time: 0.9288504 Dec 20 05:58:37.116788 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0b14fdd5-af46-4268-a3b8-06d9f0a9196b', 'tag': '99279753-6934-4d6f-88dc-e3785468af1d'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:58:37.119093 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f28dc558-ca2f-4511-8db0-8c7d5ea8887f" -d '{"events": [{"name": "network-changed", "server_uuid": "0b14fdd5-af46-4268-a3b8-06d9f0a9196b", "tag": "99279753-6934-4d6f-88dc-e3785468af1d"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:58:37.159182 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:58:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-40ceab05-8723-4248-93c0-9837938e8808 x-openstack-request-id: req-40ceab05-8723-4248-93c0-9837938e8808 {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:58:37.159493 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0b14fdd5-af46-4268-a3b8-06d9f0a9196b", "tag": "99279753-6934-4d6f-88dc-e3785468af1d", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:58:37.159798 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-40ceab05-8723-4248-93c0-9837938e8808 {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:58:37.160220 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0b14fdd5-af46-4268-a3b8-06d9f0a9196b', 'tag': '99279753-6934-4d6f-88dc-e3785468af1d', 'status': 'completed', 'code': 200} Dec 20 05:58:37.217096 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-1c7476d7-867c-4db2-83cf-e1c22dba62cf None None] Set router 3f858ad2-b10f-4f04-9727-f99638a01796 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:37.318829 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f28dc558-ca2f-4511-8db0-8c7d5ea8887f req-75bfa8eb-c670-48f4-b6e8-01a70df4ac81 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:37.320581 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f28dc558-ca2f-4511-8db0-8c7d5ea8887f req-75bfa8eb-c670-48f4-b6e8-01a70df4ac81 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1898b7c1b3dc4523b09a97486622c67e&device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 1098 time: 0.1082890 Dec 20 05:58:37.435637 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fddadb95-09c4-4c9e-a4f1-6a3e7d198d39 req-3d818482-c365-4022-8dec-1146989825b1 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:37.437115 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fddadb95-09c4-4c9e-a4f1-6a3e7d198d39 req-3d818482-c365-4022-8dec-1146989825b1 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.1005778 Dec 20 05:58:37.452990 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-1c7476d7-867c-4db2-83cf-e1c22dba62cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '1fe55298-6d1d-4aae-b449-b53519d7ed2c', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'floating_ip_address': '172.27.3.17', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'port_id': '99279753-6934-4d6f-88dc-e3785468af1d', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 535, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'mac_address': 'fa:16:3e:03:38:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0b14fdd5-af46-4268-a3b8-06d9f0a9196b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:58:14Z', 'updated_at': '2021-12-20T05:58:36Z', 'revision_number': 1, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:35Z', 'revision_number': 5, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:37.463955 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f28dc558-ca2f-4511-8db0-8c7d5ea8887f req-269c040e-a49c-4ab5-8a14-bcd498915e16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:37.465375 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f28dc558-ca2f-4511-8db0-8c7d5ea8887f req-269c040e-a49c-4ab5-8a14-bcd498915e16 service neutron] 10.222.0.54 "GET /v2.0/networks?id=6924a88e-10c1-4073-a41c-88aad14ebd0f HTTP/1.1" status: 200 len: 912 time: 0.1373794 Dec 20 05:58:37.478974 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c7476d7-867c-4db2-83cf-e1c22dba62cf None None] Checking router: 3f858ad2-b10f-4f04-9727-f99638a01796 for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:58:37.486968 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c7476d7-867c-4db2-83cf-e1c22dba62cf None None] Routers {'3f858ad2-b10f-4f04-9727-f99638a01796'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:37.487583 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-1c7476d7-867c-4db2-83cf-e1c22dba62cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['3f858ad2-b10f-4f04-9727-f99638a01796'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:37.555646 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fddadb95-09c4-4c9e-a4f1-6a3e7d198d39 req-67ae9b51-afc1-431a-a02f-4beef867fca2 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1071539 Dec 20 05:58:37.563925 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f28dc558-ca2f-4511-8db0-8c7d5ea8887f req-4599cbfa-8355-4a60-a836-d5192e5c9df3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=99279753-6934-4d6f-88dc-e3785468af1d HTTP/1.1" status: 200 len: 998 time: 0.0910373 Dec 20 05:58:37.594961 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:37.604552 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-1c7476d7-867c-4db2-83cf-e1c22dba62cf None None] Set router 3f858ad2-b10f-4f04-9727-f99638a01796 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:37.626125 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f28dc558-ca2f-4511-8db0-8c7d5ea8887f req-3f65d7a1-4998-4d87-ab29-4fda731c543c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:37.627721 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f28dc558-ca2f-4511-8db0-8c7d5ea8887f req-3f65d7a1-4998-4d87-ab29-4fda731c543c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=ffb588f9-2ffb-4921-8a76-be5179c2fbed HTTP/1.1" status: 200 len: 850 time: 0.0571434 Dec 20 05:58:37.701965 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f28dc558-ca2f-4511-8db0-8c7d5ea8887f req-8486e88a-79bb-4293-a11d-094120f161ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:37.703942 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f28dc558-ca2f-4511-8db0-8c7d5ea8887f req-8486e88a-79bb-4293-a11d-094120f161ab service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6924a88e-10c1-4073-a41c-88aad14ebd0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0513968 Dec 20 05:58:37.799805 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f28dc558-ca2f-4511-8db0-8c7d5ea8887f req-97c57efa-4eb1-4f10-9af3-a281315e2a4a service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880196 Dec 20 05:58:37.851620 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-1c7476d7-867c-4db2-83cf-e1c22dba62cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '1fe55298-6d1d-4aae-b449-b53519d7ed2c', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'floating_ip_address': '172.27.3.17', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'port_id': '99279753-6934-4d6f-88dc-e3785468af1d', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 535, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'mac_address': 'fa:16:3e:03:38:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0b14fdd5-af46-4268-a3b8-06d9f0a9196b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:58:14Z', 'updated_at': '2021-12-20T05:58:36Z', 'revision_number': 1, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:35Z', 'revision_number': 5, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:37.878582 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c7476d7-867c-4db2-83cf-e1c22dba62cf None None] The sync data for ids ['3f858ad2-b10f-4f04-9727-f99638a01796'] in dv-cinder-822278-1-iscsi is: [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '1fe55298-6d1d-4aae-b449-b53519d7ed2c', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'floating_ip_address': '172.27.3.17', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'port_id': '99279753-6934-4d6f-88dc-e3785468af1d', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 535, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'mac_address': 'fa:16:3e:03:38:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0b14fdd5-af46-4268-a3b8-06d9f0a9196b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:58:14Z', 'updated_at': '2021-12-20T05:58:36Z', 'revision_number': 1, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:35Z', 'revision_number': 5, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:58:37.903736 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f28dc558-ca2f-4511-8db0-8c7d5ea8887f req-f5ef09d4-cf9f-471c-8993-1dfe3f0b41f8 service neutron] 10.222.0.54 "GET /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0929263 Dec 20 05:58:38.072074 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-586034f0-a181-4e1b-9696-5343f7f855ad None None] New status for floating IP 1fe55298-6d1d-4aae-b449-b53519d7ed2c: ACTIVE {{(pid=102448) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 05:58:38.356790 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c0bd3cb7-e125-4526-9f45-362789ba04cd req-c358e280-2177-4b2b-9461-e4256280df2c service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0460083 Dec 20 05:58:38.458404 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0bd3cb7-e125-4526-9f45-362789ba04cd req-08c988ca-927c-4fc5-9270-108cffbd842e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:38.459870 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c0bd3cb7-e125-4526-9f45-362789ba04cd req-08c988ca-927c-4fc5-9270-108cffbd842e service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a67a7ba727e54b1c9f6ca2d5ea21f272&device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 1098 time: 0.0387437 Dec 20 05:58:38.560219 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0bd3cb7-e125-4526-9f45-362789ba04cd req-b5cb91a1-b64c-4590-afd7-1c5756d9a873 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:38.561560 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c0bd3cb7-e125-4526-9f45-362789ba04cd req-b5cb91a1-b64c-4590-afd7-1c5756d9a873 service neutron] 10.222.0.54 "GET /v2.0/networks?id=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 HTTP/1.1" status: 200 len: 910 time: 0.0816917 Dec 20 05:58:38.640733 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c0bd3cb7-e125-4526-9f45-362789ba04cd req-510391b5-fa2c-445c-b3b5-ce6ac878b2b8 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=8a9f4386-7528-40a4-9b44-826be10f5c21 HTTP/1.1" status: 200 len: 1001 time: 0.0700727 Dec 20 05:58:38.673929 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:38.713833 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af422f78-589e-4435-9faf-59989ff77b5d req-ba45d569-7fda-4d32-8f0a-ca692f7821aa tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:38.715317 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-af422f78-589e-4435-9faf-59989ff77b5d req-ba45d569-7fda-4d32-8f0a-ca692f7821aa tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.0871556 Dec 20 05:58:38.716785 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0bd3cb7-e125-4526-9f45-362789ba04cd req-f12b49ae-84b9-4e34-9ca3-d789842df947 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:38.718095 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c0bd3cb7-e125-4526-9f45-362789ba04cd req-f12b49ae-84b9-4e34-9ca3-d789842df947 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2b892f1-223d-4384-8544-8bbbbe5c621b HTTP/1.1" status: 200 len: 848 time: 0.0633025 Dec 20 05:58:38.809779 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-af422f78-589e-4435-9faf-59989ff77b5d req-d3015de1-10d0-418f-a3b1-7c6b801d82bb tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0866997 Dec 20 05:58:38.812494 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0bd3cb7-e125-4526-9f45-362789ba04cd req-767953cf-3c68-4c2b-865c-8e4e092ed4c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:38.813833 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c0bd3cb7-e125-4526-9f45-362789ba04cd req-767953cf-3c68-4c2b-865c-8e4e092ed4c9 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0841451 Dec 20 05:58:38.917300 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c0bd3cb7-e125-4526-9f45-362789ba04cd req-6ab2126b-b32c-4096-a672-7afee8a831ed service neutron] 10.222.0.54 "GET /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0960631 Dec 20 05:58:39.013790 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c0bd3cb7-e125-4526-9f45-362789ba04cd req-b4335162-3002-4f28-bf8e-f0cbf1611884 service neutron] 10.222.0.54 "GET /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861242 Dec 20 05:58:39.926521 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba3e5fa-a299-4f05-ab5b-9aa5a10b112b req-3d4f7d6c-3a5c-4fd2-9f04-b34665eb941d tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:39.928056 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2ba3e5fa-a299-4f05-ab5b-9aa5a10b112b req-3d4f7d6c-3a5c-4fd2-9f04-b34665eb941d tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.0488131 Dec 20 05:58:39.988303 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2ba3e5fa-a299-4f05-ab5b-9aa5a10b112b req-dfd6f5cf-ed03-4b42-a697-557704e7840c tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0537834 Dec 20 05:58:41.111477 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e0f6425-c4b3-4475-b1ce-a472c884e333 req-d868660b-d4e3-4135-b418-eaf803d482a3 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:41.115371 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5e0f6425-c4b3-4475-b1ce-a472c884e333 req-d868660b-d4e3-4135-b418-eaf803d482a3 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.0562222 Dec 20 05:58:41.175608 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5e0f6425-c4b3-4475-b1ce-a472c884e333 req-01860530-ad44-47d9-ba19-e6108eaaace3 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&id=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0536811 Dec 20 05:58:44.505403 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48214) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:44.549511 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_v2 [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Deleting subnet 8265e939-4727-4318-be2f-9d57754a238e {{(pid=102446) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 05:58:44.552426 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:44.593733 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8976279'] for subnet, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:44.641649 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:44.693011 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9173344', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3270978'] for subnet, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:44.718223 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8265e939-4727-4318-be2f-9d57754a238e,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:44.722606 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:44.725884 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] 10.222.0.46 "DELETE /v2.0/subnets/8265e939-4727-4318-be2f-9d57754a238e HTTP/1.1" status: 204 len: 168 time: 0.2194555 Dec 20 05:58:44.728433 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 48216) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:44.730638 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:44.731041 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:44.731329 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:44.731702 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:44.732036 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:44.732362 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:44.732689 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:44.733015 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:44.733340 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:44.733663 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:44.733985 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:44.734305 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:44.734626 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8131c5bb-7436-4bd4-a904-f9f6ef19c74e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:58:44.794647 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-669130b7-5129-451a-b6f5-3b7eb3fc8ca4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:44.873467 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-669130b7-5129-451a-b6f5-3b7eb3fc8ca4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:44.893064 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-669130b7-5129-451a-b6f5-3b7eb3fc8ca4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9da693b1-1216-4020-9114-46c9936e8a72']}} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:44.902236 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-669130b7-5129-451a-b6f5-3b7eb3fc8ca4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '62bdd930-d981-4fed-ad58-9d410d5c0393') {'for_net_delete': True} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:44.902521 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-669130b7-5129-451a-b6f5-3b7eb3fc8ca4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '62bdd930-d981-4fed-ad58-9d410d5c0393') {} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:44.911312 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-669130b7-5129-451a-b6f5-3b7eb3fc8ca4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3457718'] for segment, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:44.924479 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-669130b7-5129-451a-b6f5-3b7eb3fc8ca4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:44.930987 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-669130b7-5129-451a-b6f5-3b7eb3fc8ca4 admin admin] Releasing vlan 418 on physical network physnet1 to pool {{(pid=102445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 05:58:44.931479 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-669130b7-5129-451a-b6f5-3b7eb3fc8ca4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3465205'] for segment, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: Traceback (most recent call last): Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: timer() Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: cb(*args, **kw) Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: return func(*args, **kwargs) Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: self._notify() Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: self.callback(batched_events) Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: event.method(event) Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: return f(self, *a, **k) Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._get(url).json() Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: return self.request(url, 'GET', **kwargs) Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 05:58:44.933233 dv-cinder-822278-1-iscsi neutron-server[102445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 05:58:45.000054 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-669130b7-5129-451a-b6f5-3b7eb3fc8ca4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:45.005260 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-669130b7-5129-451a-b6f5-3b7eb3fc8ca4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:45.009233 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-669130b7-5129-451a-b6f5-3b7eb3fc8ca4 admin admin] 10.222.0.46 "DELETE /v2.0/networks/9da693b1-1216-4020-9114-46c9936e8a72 HTTP/1.1" status: 204 len: 168 time: 0.2798049 Dec 20 05:58:45.019955 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-669130b7-5129-451a-b6f5-3b7eb3fc8ca4 admin admin] Pushing event deleted for resources: {'Network': ['ID=9da693b1-1216-4020-9114-46c9936e8a72,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:45.119418 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48222) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:45.157743 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-5f3b114a-66c2-403b-83a8-3fdd45fb3007 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=a0ce0dc0b4da4cb093e9599f5cddd0c9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0371301 Dec 20 05:58:45.160013 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48224) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:45.206393 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c12772be-5a7a-4c9b-b724-d7d686a4627c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:45.227673 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c12772be-5a7a-4c9b-b724-d7d686a4627c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:45.275602 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c12772be-5a7a-4c9b-b724-d7d686a4627c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:45.278099 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c12772be-5a7a-4c9b-b724-d7d686a4627c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:45.279236 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-c12772be-5a7a-4c9b-b724-d7d686a4627c admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/86dd8038-82cb-4fbf-954a-3aaaf1887354 HTTP/1.1" status: 204 len: 168 time: 0.1183579 Dec 20 05:58:45.286810 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c12772be-5a7a-4c9b-b724-d7d686a4627c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86dd8038-82cb-4fbf-954a-3aaaf1887354,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:45.924072 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 48248) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:46.024783 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-2136067587-network', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:46.047310 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] Made reservation on behalf of 1aefc80d27d3426daae57e2b0a4cbbbb for: {'network': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:58:46.049582 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.057943 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.132532 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.136351 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.160443 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] vlan segment allocate from pool success with {'vlan_id': 448, 'physical_network': 'physnet1'} {{(pid=102445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:58:46.168943 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da71868c-172f-49f8-9415-ef9f75cc2d46,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:46.174577 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.174915 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.segments_db [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] Added segment 843466c5-3ffc-45e2-aa9c-b62cf8d89afd of type vlan for network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 Dec 20 05:58:46.214762 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.237612 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.238524 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:46.239115 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.275362 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.3502095 Dec 20 05:58:46.278341 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48254) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:46.283323 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-a8ba1489-edf3-4407-8a44-1ffbfd4e07b0 admin admin] Request body: {'subnet': {'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-2136067587-subnet', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'ip_version': 4}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:46.301651 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a684e68-dba7-40fd-8a5e-cfa99f0d1459 admin admin] Pushing event updated for resources: {'Network': ['ID=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:46.312019 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8ba1489-edf3-4407-8a44-1ffbfd4e07b0 admin admin] Made reservation on behalf of 1aefc80d27d3426daae57e2b0a4cbbbb for: {'subnet': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:58:46.312857 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:58:46.314534 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a8ba1489-edf3-4407-8a44-1ffbfd4e07b0 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3270951'] for subnet, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.483847 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a8ba1489-edf3-4407-8a44-1ffbfd4e07b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9168037', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3270985'] for subnet, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.535640 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8ba1489-edf3-4407-8a44-1ffbfd4e07b0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:46.547057 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8ba1489-edf3-4407-8a44-1ffbfd4e07b0 admin admin] Checking segment: {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:58:46.547415 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8ba1489-edf3-4407-8a44-1ffbfd4e07b0 admin admin] Network hostable DHCP agents. Network: ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102446) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:58:46.563697 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8ba1489-edf3-4407-8a44-1ffbfd4e07b0 admin admin] Network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102446) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:58:46.571720 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-a8ba1489-edf3-4407-8a44-1ffbfd4e07b0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6) {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:46.575610 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8ba1489-edf3-4407-8a44-1ffbfd4e07b0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:46.576204 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a8ba1489-edf3-4407-8a44-1ffbfd4e07b0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.580728 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9834d966-e44a-46a9-8cc8-cfc3a572d17b None None] Network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:58:46.591202 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-a8ba1489-edf3-4407-8a44-1ffbfd4e07b0 admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3117423 Dec 20 05:58:46.593825 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48256) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:46.598001 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:46.621084 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1698740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25959'] for router, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.622174 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1698340', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1703163', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1634740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25982'] for router, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.676845 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.706180 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf82c7edd-7168-52b9-b9ff-dee431eec71c-ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e'}]}} from dv-cinder-822278-1-iscsi. {{(pid=102447) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 20 05:58:46.707161 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:46.850075 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.db_base_plugin_common [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Allocated IP 172.20.0.2 (ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6/41d28c9a-6c88-4c21-87ff-6f5f781d2b3e/5f243c0c-704a-40b7-b2f2-53e6f999503f) {{(pid=102447) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:58:47.051230 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:47.123851 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Publish callbacks [] for port, precommit_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:47.129486 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:47.177793 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 is already hosted by enough agents. {{(pid=102447) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:47.180818 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.base_scheduler [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Resources bound (agent type, host, resource id): {{(pid=102447) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:47.184334 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Received port after_create {{(pid=102447) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:58:47.193483 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Pushing event updated for resources: {'Port': ['ID=5f243c0c-704a-40b7-b2f2-53e6f999503f,revision_number=1']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:47.243363 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Attempting to bind port 5f243c0c-704a-40b7-b2f2-53e6f999503f on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:58:47.243767 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Attempting to bind port 5f243c0c-704a-40b7-b2f2-53e6f999503f by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:58:47.244132 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Attempting to bind port 5f243c0c-704a-40b7-b2f2-53e6f999503f on network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:58:47.249067 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:47.249561 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 58, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:58:47.249942 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Checking segment: {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:58:47.250342 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:47.250737 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Bound using segment: {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:58:47.251213 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Bound port: 5f243c0c-704a-40b7-b2f2-53e6f999503f, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:58:47.252212 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:47.268046 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:47.316112 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] For port 5f243c0c-704a-40b7-b2f2-53e6f999503f, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:58:47.320231 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] For port 5f243c0c-704a-40b7-b2f2-53e6f999503f, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=5f243c0c-704a-40b7-b2f2-53e6f999503f,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:58:47.324492 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:47.377694 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Allocated IP 172.27.3.114 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/af6c392d-edd1-4fbf-84ee-b0e50edcc1b6) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:58:47.381566 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-427620f9-39bf-474e-8152-2698544ebd29 None None] Pushing event updated for resources: {'Port': ['ID=5f243c0c-704a-40b7-b2f2-53e6f999503f,revision_number=2']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:47.488043 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:47.523423 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:47.570438 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:47.573245 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:47.576533 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:58:47.582198 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Pushing event updated for resources: {'Port': ['ID=af6c392d-edd1-4fbf-84ee-b0e50edcc1b6,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:47.838761 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:47.978788 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 5f243c0c-704a-40b7-b2f2-53e6f999503f up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:48.034751 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 5f243c0c-704a-40b7-b2f2-53e6f999503f triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:48.035413 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:48.040181 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1698355', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1703078'] for router, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:48.120041 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:48.153778 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port 5f243c0c-704a-40b7-b2f2-53e6f999503f, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=5f243c0c-704a-40b7-b2f2-53e6f999503f,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:48.158090 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:48.173735 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Router 8700450f-8a60-4f59-88d0-7c64696c2fae is scheduled to L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d with binding_index 1 {{(pid=102446) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 20 05:58:48.214181 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=5f243c0c-704a-40b7-b2f2-53e6f999503f,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:48.293659 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:58:48.306807 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Sync routers for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:58:48.319307 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:48.319926 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] Publish callbacks [] for router, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:48.320031 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:48.323848 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-7e6f5f59-487a-4048-b18b-675dbc6b8d76 admin admin] 10.222.0.46 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 1.7265005 Dec 20 05:58:48.324036 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48266) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:48.358769 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89b05ebf-35c1-43b1-940a-e2f5d6717bcb None None] Network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:58:48.480075 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-cf352954-c8d5-47f3-be26-2c7202b5a3c5 None None] Provisioning complete for port 5f243c0c-704a-40b7-b2f2-53e6f999503f triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:48.480355 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-cf352954-c8d5-47f3-be26-2c7202b5a3c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:48.521291 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:48.729879 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:48.776021 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:47Z', 'revision_number': 3, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:47Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:48.804899 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Checking router: 8700450f-8a60-4f59-88d0-7c64696c2fae for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:58:48.805268 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Updating router 8700450f-8a60-4f59-88d0-7c64696c2fae port af6c392d-edd1-4fbf-84ee-b0e50edcc1b6 binding host dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:58:48.831810 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:48.892403 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Allocated IP 172.20.0.1 (ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6/41d28c9a-6c88-4c21-87ff-6f5f781d2b3e/c071b8e1-d00c-4569-8631-3a6ae482ed1a) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:58:48.972398 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-be5524ff-0018-4da6-9866-bdce1f99441f None None] Provisioning complete for port 5f243c0c-704a-40b7-b2f2-53e6f999503f triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:48.972876 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-be5524ff-0018-4da6-9866-bdce1f99441f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.004292 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.037620 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.077644 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:49.082052 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:49.086350 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:58:49.089301 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Pushing event updated for resources: {'Port': ['ID=c071b8e1-d00c-4569-8631-3a6ae482ed1a,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:49.126691 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1703675'] for router_interface, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.170102 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Publish callbacks [] for port, precommit_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.176464 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.238884 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-067cee1a-df35-4fce-9640-2ed2265b99c1 None None] Pushing event updated for resources: {'Port': ['ID=af6c392d-edd1-4fbf-84ee-b0e50edcc1b6,revision_number=2']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:49.242513 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Attempting to bind port af6c392d-edd1-4fbf-84ee-b0e50edcc1b6 on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:58:49.242669 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Attempting to bind port af6c392d-edd1-4fbf-84ee-b0e50edcc1b6 by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:58:49.242967 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Attempting to bind port af6c392d-edd1-4fbf-84ee-b0e50edcc1b6 on network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:58:49.248746 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 58, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:58:49.249126 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Checking segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:58:49.249525 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.249909 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Bound using segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:58:49.250551 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Bound port: af6c392d-edd1-4fbf-84ee-b0e50edcc1b6, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:58:49.250936 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.262104 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.315148 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] For port af6c392d-edd1-4fbf-84ee-b0e50edcc1b6, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:58:49.325750 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] For port af6c392d-edd1-4fbf-84ee-b0e50edcc1b6, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=af6c392d-edd1-4fbf-84ee-b0e50edcc1b6,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:58:49.330563 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.394796 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-05c061be-c595-41a7-908b-8ec79df39ca4 None None] Provisioning complete for port c071b8e1-d00c-4569-8631-3a6ae482ed1a triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:49.395158 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-05c061be-c595-41a7-908b-8ec79df39ca4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.422141 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-067cee1a-df35-4fce-9640-2ed2265b99c1 None None] Pushing event updated for resources: {'Port': ['ID=af6c392d-edd1-4fbf-84ee-b0e50edcc1b6,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:49.427277 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:49.427923 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:49.453576 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.457967 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.480084 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-05c061be-c595-41a7-908b-8ec79df39ca4 None None] Port c071b8e1-d00c-4569-8631-3a6ae482ed1a cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:58:49.526706 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1617520', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1697131'] for router_interface, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.529278 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Pushing event updated for resources: {'Port': ['ID=c071b8e1-d00c-4569-8631-3a6ae482ed1a,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:49.544124 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:49.633694 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:49.635197 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:49.758452 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Router 8700450f-8a60-4f59-88d0-7c64696c2fae has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:58:49.867282 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:58:49.872300 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-ee41ef5f-2c04-4a75-b4ec-6ebe82c98d2a admin admin] 10.222.0.46 "PUT /v2.0/routers/8700450f-8a60-4f59-88d0-7c64696c2fae/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5473230 Dec 20 05:58:49.887557 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:48Z', 'revision_number': 1, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:49.917831 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7be4136c-2484-4572-9848-7d41988bb841 None None] The sync data for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi is: [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:48Z', 'revision_number': 1, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:58:49.926873 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-9c13d3f4-c227-4d30-bb00-34c896a86147 None None] Provisioning complete for port c071b8e1-d00c-4569-8631-3a6ae482ed1a triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:49.927305 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-9c13d3f4-c227-4d30-bb00-34c896a86147 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:49.967973 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-9c13d3f4-c227-4d30-bb00-34c896a86147 None None] Port c071b8e1-d00c-4569-8631-3a6ae482ed1a cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:58:49.979820 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 5f243c0c-704a-40b7-b2f2-53e6f999503f up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:50.036506 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 5f243c0c-704a-40b7-b2f2-53e6f999503f triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:50.037181 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:50.419499 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48288) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:50.424391 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-714357623-network', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:50.447121 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] Made reservation on behalf of d020afd8bc604ba292b2ea20a846895b for: {'network': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:58:50.449613 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:50.458762 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:50.540556 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:50.546671 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:50.588343 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] vlan segment allocate from pool success with {'vlan_id': 435, 'physical_network': 'physnet1'} {{(pid=102446) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 05:58:50.594778 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56ddba2d-7f91-41e7-aa0e-3abce3ca8c18,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:50.601468 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:50.601813 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.segments_db [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] Added segment 3dde54c0-d21a-4029-a188-85abe638860e of type vlan for network bc6ff48e-9cc3-4803-8a65-7ec1d02b5478 Dec 20 05:58:50.650848 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:50.677352 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:50.679110 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:50.679801 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:50.719882 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.2990415 Dec 20 05:58:50.722431 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 48292) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:50.728906 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-82c20320-2985-4f71-8403-af229c154356 admin admin] Request body: {'subnet': {'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-714357623-subnet', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'ip_version': 4}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:50.747312 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca572dd-cd81-4d98-bd95-56e4c90cc49f admin admin] Pushing event updated for resources: {'Network': ['ID=bc6ff48e-9cc3-4803-8a65-7ec1d02b5478,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:50.752871 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82c20320-2985-4f71-8403-af229c154356 admin admin] Made reservation on behalf of d020afd8bc604ba292b2ea20a846895b for: {'subnet': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:58:50.755587 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-82c20320-2985-4f71-8403-af229c154356 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3597747'] for subnet, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:50.757883 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network bc6ff48e-9cc3-4803-8a65-7ec1d02b5478 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 05:58:50.929180 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-82c20320-2985-4f71-8403-af229c154356 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3457622', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3597789'] for subnet, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:50.968699 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:58:50.986002 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82c20320-2985-4f71-8403-af229c154356 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ed59ecbe-71dc-425e-a0db-d530f6b7243d,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:50.995425 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82c20320-2985-4f71-8403-af229c154356 admin admin] Checking segment: {'id': '3dde54c0-d21a-4029-a188-85abe638860e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:58:50.995816 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82c20320-2985-4f71-8403-af229c154356 admin admin] Network hostable DHCP agents. Network: bc6ff48e-9cc3-4803-8a65-7ec1d02b5478, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 05:58:51.013513 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82c20320-2985-4f71-8403-af229c154356 admin admin] Network bc6ff48e-9cc3-4803-8a65-7ec1d02b5478 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 05:58:51.023263 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-82c20320-2985-4f71-8403-af229c154356 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, bc6ff48e-9cc3-4803-8a65-7ec1d02b5478) {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:51.027555 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82c20320-2985-4f71-8403-af229c154356 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:58:51.028211 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-82c20320-2985-4f71-8403-af229c154356 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:51.032219 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27fe083f-865b-4f0a-880d-f871de7138ee None None] Network bc6ff48e-9cc3-4803-8a65-7ec1d02b5478 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:58:51.044746 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-82c20320-2985-4f71-8403-af229c154356 admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3204675 Dec 20 05:58:51.047392 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48294) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:51.052617 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-714357623-router', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:51.077055 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1698740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25959'] for router, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:51.078669 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1698340', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1703163', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1634740', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25982'] for router, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:51.133467 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:51.140550 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf82c7edd-7168-52b9-b9ff-dee431eec71c-bc6ff48e-9cc3-4803-8a65-7ec1d02b5478', 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478', 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'fixed_ips': [{'subnet_id': 'ed59ecbe-71dc-425e-a0db-d530f6b7243d'}]}} from dv-cinder-822278-1-iscsi. {{(pid=102447) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 20 05:58:51.141419 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:51.288909 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.db_base_plugin_common [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Allocated IP 172.20.0.2 (bc6ff48e-9cc3-4803-8a65-7ec1d02b5478/ed59ecbe-71dc-425e-a0db-d530f6b7243d/e2360595-d33d-441e-96cb-793e58e8deda) {{(pid=102447) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:58:51.439480 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Publish callbacks [] for port, precommit_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:51.445309 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331'] for port, after_create {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:51.488271 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Network bc6ff48e-9cc3-4803-8a65-7ec1d02b5478 is already hosted by enough agents. {{(pid=102447) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:51.490991 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.scheduler.base_scheduler [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Resources bound (agent type, host, resource id): {{(pid=102447) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:51.494300 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Received port after_create {{(pid=102447) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:58:51.501911 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Pushing event updated for resources: {'Port': ['ID=e2360595-d33d-441e-96cb-793e58e8deda,revision_number=1']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:51.531897 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:51.551406 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Attempting to bind port e2360595-d33d-441e-96cb-793e58e8deda on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:58:51.551819 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Attempting to bind port e2360595-d33d-441e-96cb-793e58e8deda by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '3dde54c0-d21a-4029-a188-85abe638860e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:58:51.552180 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Attempting to bind port e2360595-d33d-441e-96cb-793e58e8deda on network bc6ff48e-9cc3-4803-8a65-7ec1d02b5478 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:58:51.557684 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 58, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:58:51.558069 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Checking segment: {'id': '3dde54c0-d21a-4029-a188-85abe638860e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:58:51.558437 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:51.558832 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Bound using segment: {'id': '3dde54c0-d21a-4029-a188-85abe638860e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:58:51.559291 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Bound port: e2360595-d33d-441e-96cb-793e58e8deda, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3dde54c0-d21a-4029-a188-85abe638860e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:58:51.559708 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:51.623358 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] For port e2360595-d33d-441e-96cb-793e58e8deda, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:58:51.626473 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] For port e2360595-d33d-441e-96cb-793e58e8deda, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=e2360595-d33d-441e-96cb-793e58e8deda,segment=NetworkSegment(3dde54c0-d21a-4029-a188-85abe638860e),segment_id=3dde54c0-d21a-4029-a188-85abe638860e)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:58:51.630780 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:51.695755 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04601a38-c23c-4461-94ea-7561fe828538 None None] Pushing event updated for resources: {'Port': ['ID=e2360595-d33d-441e-96cb-793e58e8deda,revision_number=2']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:51.757271 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:51.778218 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:51.914326 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Allocated IP 172.27.3.131 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/7269a2ab-2dd4-4b8b-b1bf-536003a0d27b) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:58:51.986507 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Sync routers for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:58:52.005312 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:52.007733 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:52.046519 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.060685 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device af6c392d-edd1-4fbf-84ee-b0e50edcc1b6 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:52.089758 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.117561 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port af6c392d-edd1-4fbf-84ee-b0e50edcc1b6 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:52.117933 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.125961 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:52.132344 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:52.135339 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:52.138776 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:58:52.162419 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Pushing event updated for resources: {'Port': ['ID=7269a2ab-2dd4-4b8b-b1bf-536003a0d27b,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:52.205257 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.232827 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port af6c392d-edd1-4fbf-84ee-b0e50edcc1b6, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=af6c392d-edd1-4fbf-84ee-b0e50edcc1b6,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:52.237364 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.238348 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device e2360595-d33d-441e-96cb-793e58e8deda up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:52.317037 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=af6c392d-edd1-4fbf-84ee-b0e50edcc1b6,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:52.329096 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port e2360595-d33d-441e-96cb-793e58e8deda triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:52.329468 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.342068 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 2, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:52.370470 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Checking router: 8700450f-8a60-4f59-88d0-7c64696c2fae for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:58:52.371087 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Updating router 8700450f-8a60-4f59-88d0-7c64696c2fae port c071b8e1-d00c-4569-8631-3a6ae482ed1a binding host dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:58:52.413780 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.445684 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.449754 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.487319 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port e2360595-d33d-441e-96cb-793e58e8deda, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=e2360595-d33d-441e-96cb-793e58e8deda,segment=NetworkSegment(3dde54c0-d21a-4029-a188-85abe638860e),segment_id=3dde54c0-d21a-4029-a188-85abe638860e)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:52.493149 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.556443 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=e2360595-d33d-441e-96cb-793e58e8deda,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:52.703129 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1698355', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1703078'] for router, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.707480 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Publish callbacks [] for port, precommit_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.714921 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.735246 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5ab32e23-fd56-4dfb-830f-c0d8507c18f9 None None] Network bc6ff48e-9cc3-4803-8a65-7ec1d02b5478 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:58:52.780490 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a59a5ba-5392-4f77-abcf-4a4e5fe87c2d None None] Pushing event updated for resources: {'Port': ['ID=c071b8e1-d00c-4569-8631-3a6ae482ed1a,revision_number=3']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:52.825291 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-f765325e-300e-4d33-b288-c63078ad5221 None None] Provisioning complete for port e2360595-d33d-441e-96cb-793e58e8deda triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:52.825555 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f765325e-300e-4d33-b288-c63078ad5221 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.846135 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Router 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 is scheduled to L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d with binding_index 1 {{(pid=102446) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 20 05:58:52.896868 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Attempting to bind port c071b8e1-d00c-4569-8631-3a6ae482ed1a on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:58:52.898564 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Attempting to bind port c071b8e1-d00c-4569-8631-3a6ae482ed1a by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:58:52.898564 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Attempting to bind port c071b8e1-d00c-4569-8631-3a6ae482ed1a on network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:58:52.910390 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 58, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:58:52.912050 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Checking segment: {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102448) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:58:52.912653 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.913297 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Bound using segment: {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:58:52.916290 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Bound port: c071b8e1-d00c-4569-8631-3a6ae482ed1a, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'}}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:58:52.916936 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:52.994583 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] For port c071b8e1-d00c-4569-8631-3a6ae482ed1a, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102448) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:58:52.996905 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:58:52.997847 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] For port c071b8e1-d00c-4569-8631-3a6ae482ed1a, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=c071b8e1-d00c-4569-8631-3a6ae482ed1a,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102448) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:58:53.007690 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Sync routers for ids ['4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:58:53.009648 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:53.020754 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Routers {'4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:53.021588 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-13667188-5e51-4a72-af90-d133990ea7af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:53.033101 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] Publish callbacks [] for router, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:53.035209 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-83fb4fea-6b87-4c44-ae64-fb536b09802d admin admin] 10.222.0.46 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.9864922 Dec 20 05:58:53.037802 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48304) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:53.097412 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:53.098194 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:53.164604 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a59a5ba-5392-4f77-abcf-4a4e5fe87c2d None None] Pushing event updated for resources: {'Port': ['ID=c071b8e1-d00c-4569-8631-3a6ae482ed1a,revision_number=4']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:53.185464 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-47383410-ebf7-4366-9eaf-338ae92e4e97 None None] Provisioning complete for port c071b8e1-d00c-4569-8631-3a6ae482ed1a triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:53.185994 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-47383410-ebf7-4366-9eaf-338ae92e4e97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:53.191724 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Set router 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:53.235174 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:53.437909 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-47383410-ebf7-4366-9eaf-338ae92e4e97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:53.463831 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:53.479607 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-47383410-ebf7-4366-9eaf-338ae92e4e97 None None] For port c071b8e1-d00c-4569-8631-3a6ae482ed1a, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=c071b8e1-d00c-4569-8631-3a6ae482ed1a,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:53.490728 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-47383410-ebf7-4366-9eaf-338ae92e4e97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:53.491907 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50041808-ca84-4dd3-81f3-786c2eecef72 None None] The sync data for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi is: [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:58:53.519328 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-13667188-5e51-4a72-af90-d133990ea7af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'name': 'tempest-TestVolumeBootPattern-714357623-router', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.131'}], 'enable_snat': True}, 'gw_port_id': '7269a2ab-2dd4-4b8b-b1bf-536003a0d27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 3, 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'gw_port': {'id': '7269a2ab-2dd4-4b8b-b1bf-536003a0d27b', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:c8:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T05:58:51Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:53.555629 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:53.558665 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Checking router: 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:58:53.559097 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Updating router 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 port 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b binding host dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:58:53.596157 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:53.597971 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47383410-ebf7-4366-9eaf-338ae92e4e97 None None] Pushing event updated for resources: {'Port': ['ID=c071b8e1-d00c-4569-8631-3a6ae482ed1a,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:53.693244 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-986c2d27-467c-49fc-955a-1b0819c7a2f4 None None] Provisioning complete for port c071b8e1-d00c-4569-8631-3a6ae482ed1a triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:53.693528 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-986c2d27-467c-49fc-955a-1b0819c7a2f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:53.735148 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Allocated IP 172.20.0.1 (bc6ff48e-9cc3-4803-8a65-7ec1d02b5478/ed59ecbe-71dc-425e-a0db-d530f6b7243d/ebbdc4a9-0881-4586-8531-cde9c9ac026a) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:58:53.852102 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:53.888569 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:53.925189 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Network bc6ff48e-9cc3-4803-8a65-7ec1d02b5478 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:53.928197 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:53.930704 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:58:53.980307 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Pushing event updated for resources: {'Port': ['ID=ebbdc4a9-0881-4586-8531-cde9c9ac026a,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:53.992658 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1703675'] for router_interface, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:54.114566 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device af6c392d-edd1-4fbf-84ee-b0e50edcc1b6 up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:54.140781 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Publish callbacks [] for port, precommit_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:54.142445 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-986c2d27-467c-49fc-955a-1b0819c7a2f4 None None] Provisioning complete for port e2360595-d33d-441e-96cb-793e58e8deda triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:54.142808 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-986c2d27-467c-49fc-955a-1b0819c7a2f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:54.171886 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:54.174077 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:54.261196 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8976100c-dadd-4fb5-bded-f74d44f1b98d None None] Pushing event updated for resources: {'Port': ['ID=7269a2ab-2dd4-4b8b-b1bf-536003a0d27b,revision_number=2']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:54.264282 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Attempting to bind port 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:58:54.264656 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Attempting to bind port 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:58:54.265025 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Attempting to bind port 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b on network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:58:54.278364 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 58, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:58:54.278743 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Checking segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:58:54.279159 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:54.279609 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Bound using segment: {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'} {{(pid=102447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:58:54.280050 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.managers [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Bound port: 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '33a54534-46f6-4df5-9e55-51864e25c4b0', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}}] {{(pid=102447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:58:54.280463 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:54.327795 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port af6c392d-edd1-4fbf-84ee-b0e50edcc1b6 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:54.328170 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:54.353607 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:54.358606 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:54.406958 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-13667188-5e51-4a72-af90-d133990ea7af None None] For port 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:58:54.410537 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-13667188-5e51-4a72-af90-d133990ea7af None None] For port 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=7269a2ab-2dd4-4b8b-b1bf-536003a0d27b,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:58:54.416748 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:54.434024 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1617520', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1697131'] for router_interface, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:54.435875 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Pushing event updated for resources: {'Port': ['ID=ebbdc4a9-0881-4586-8531-cde9c9ac026a,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:54.504380 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Routers {'4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:54.504972 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-13667188-5e51-4a72-af90-d133990ea7af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:54.528461 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Network bc6ff48e-9cc3-4803-8a65-7ec1d02b5478 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:58:54.530053 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:58:54.547876 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device c071b8e1-d00c-4569-8631-3a6ae482ed1a up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:54.552629 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8976100c-dadd-4fb5-bded-f74d44f1b98d None None] Pushing event updated for resources: {'Port': ['ID=7269a2ab-2dd4-4b8b-b1bf-536003a0d27b,revision_number=3']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:54.636904 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-77f63eca-d1f7-435d-b7d4-e4e196a2b4f1 None None] Provisioning complete for port ebbdc4a9-0881-4586-8531-cde9c9ac026a triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:54.637239 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-77f63eca-d1f7-435d-b7d4-e4e196a2b4f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:54.655289 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Router 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:58:54.701961 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-13667188-5e51-4a72-af90-d133990ea7af None None] Set router 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:54.734335 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-77f63eca-d1f7-435d-b7d4-e4e196a2b4f1 None None] Port ebbdc4a9-0881-4586-8531-cde9c9ac026a cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:58:54.746048 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port c071b8e1-d00c-4569-8631-3a6ae482ed1a triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:54.746423 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:54.908311 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-7511250d-cd40-42fd-9d60-4fbb70a772cf None None] Provisioning complete for port ebbdc4a9-0881-4586-8531-cde9c9ac026a triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:54.908686 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-7511250d-cd40-42fd-9d60-4fbb70a772cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:55.002101 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device e2360595-d33d-441e-96cb-793e58e8deda up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:55.005700 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-7511250d-cd40-42fd-9d60-4fbb70a772cf None None] Port ebbdc4a9-0881-4586-8531-cde9c9ac026a cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:58:55.026145 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:58:55.031212 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-fdacbe53-3803-420b-b671-4df743663ab5 admin admin] 10.222.0.46 "PUT /v2.0/routers/4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9923508 Dec 20 05:58:55.059858 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-13667188-5e51-4a72-af90-d133990ea7af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'name': 'tempest-TestVolumeBootPattern-714357623-router', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.131'}], 'enable_snat': True}, 'gw_port_id': '7269a2ab-2dd4-4b8b-b1bf-536003a0d27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T05:58:54Z', 'revision_number': 4, 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'gw_port': {'id': '7269a2ab-2dd4-4b8b-b1bf-536003a0d27b', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:c8:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T05:58:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'ebbdc4a9-0881-4586-8531-cde9c9ac026a', 'name': '', 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'mac_address': 'fa:16:3e:21:b1:94', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': 'ed59ecbe-71dc-425e-a0db-d530f6b7243d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:53Z', 'updated_at': '2021-12-20T05:58:54Z', 'revision_number': 2, 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'subnets': [{'id': 'ed59ecbe-71dc-425e-a0db-d530f6b7243d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:55.065247 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port e2360595-d33d-441e-96cb-793e58e8deda triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:55.065614 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:55.090834 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13667188-5e51-4a72-af90-d133990ea7af None None] The sync data for ids ['4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'] in dv-cinder-822278-1-iscsi is: [{'id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'name': 'tempest-TestVolumeBootPattern-714357623-router', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.131'}], 'enable_snat': True}, 'gw_port_id': '7269a2ab-2dd4-4b8b-b1bf-536003a0d27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T05:58:54Z', 'revision_number': 4, 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'gw_port': {'id': '7269a2ab-2dd4-4b8b-b1bf-536003a0d27b', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:c8:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T05:58:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'ebbdc4a9-0881-4586-8531-cde9c9ac026a', 'name': '', 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'mac_address': 'fa:16:3e:21:b1:94', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': 'ed59ecbe-71dc-425e-a0db-d530f6b7243d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:53Z', 'updated_at': '2021-12-20T05:58:54Z', 'revision_number': 2, 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'subnets': [{'id': 'ed59ecbe-71dc-425e-a0db-d530f6b7243d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:58:55.625975 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48320) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:55.630571 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-5480408c-30cc-4c88-9c31-7f7659478982 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-487768033', 'description': 'tempest-secgroup-smoke-487768033 description', 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:55.661283 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5480408c-30cc-4c88-9c31-7f7659478982 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:55.738464 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5480408c-30cc-4c88-9c31-7f7659478982 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:55.743738 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5480408c-30cc-4c88-9c31-7f7659478982 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:55.775360 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5480408c-30cc-4c88-9c31-7f7659478982 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:55.776603 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-5480408c-30cc-4c88-9c31-7f7659478982 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1496124 Dec 20 05:58:55.777695 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5480408c-30cc-4c88-9c31-7f7659478982 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9e3980a1-6cf9-4277-a78d-dd743d8d3bde,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:55.779852 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 48322) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:55.785938 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-5b7d1040-1b83-4b79-b4ae-a068a7a867f4 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Request body: {'security_group_rule': {'security_group_id': '9e3980a1-6cf9-4277-a78d-dd743d8d3bde', 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:55.814432 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-5b7d1040-1b83-4b79-b4ae-a068a7a867f4 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:55.872457 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-5b7d1040-1b83-4b79-b4ae-a068a7a867f4 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:55.875819 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-5b7d1040-1b83-4b79-b4ae-a068a7a867f4 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:55.892875 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b7d1040-1b83-4b79-b4ae-a068a7a867f4 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bee0b852-2d57-441f-b935-298c0264b09c,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:55.903325 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-5b7d1040-1b83-4b79-b4ae-a068a7a867f4 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:55.903325 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-5b7d1040-1b83-4b79-b4ae-a068a7a867f4 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1217875 Dec 20 05:58:55.905301 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 48326) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:55.909628 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-708ca4be-d13e-4790-bb26-a2d620f83af8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Request body: {'security_group_rule': {'security_group_id': '9e3980a1-6cf9-4277-a78d-dd743d8d3bde', 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:55.941201 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-708ca4be-d13e-4790-bb26-a2d620f83af8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:55.999921 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-708ca4be-d13e-4790-bb26-a2d620f83af8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.003343 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-708ca4be-d13e-4790-bb26-a2d620f83af8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.021344 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-708ca4be-d13e-4790-bb26-a2d620f83af8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e6f7c27a-c669-4a93-ad6f-01a9ed542e2c,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:56.027864 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-708ca4be-d13e-4790-bb26-a2d620f83af8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.029019 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-708ca4be-d13e-4790-bb26-a2d620f83af8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1228008 Dec 20 05:58:56.031682 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 48328) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:56.035748 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-18a8b4f1-04f1-4334-9f27-3ca051c47d28 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Request body: {'security_group_rule': {'security_group_id': '9e3980a1-6cf9-4277-a78d-dd743d8d3bde', 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:56.061723 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-18a8b4f1-04f1-4334-9f27-3ca051c47d28 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.115499 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-18a8b4f1-04f1-4334-9f27-3ca051c47d28 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.119539 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-18a8b4f1-04f1-4334-9f27-3ca051c47d28 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.137189 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8b4f1-04f1-4334-9f27-3ca051c47d28 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=32fb4678-58f1-49e8-ae27-e5550b0eb77a,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:56.141935 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-18a8b4f1-04f1-4334-9f27-3ca051c47d28 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.143077 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-18a8b4f1-04f1-4334-9f27-3ca051c47d28 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1105030 Dec 20 05:58:56.145779 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 48330) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:56.149920 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-313212fa-8ff5-47d2-9996-98276b53a023 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Request body: {'security_group_rule': {'security_group_id': '9e3980a1-6cf9-4277-a78d-dd743d8d3bde', 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:56.175713 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-313212fa-8ff5-47d2-9996-98276b53a023 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.232291 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-313212fa-8ff5-47d2-9996-98276b53a023 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.237423 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-313212fa-8ff5-47d2-9996-98276b53a023 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.266248 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-313212fa-8ff5-47d2-9996-98276b53a023 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.271636 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-313212fa-8ff5-47d2-9996-98276b53a023 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1237192 Dec 20 05:58:56.272367 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48332) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:56.273056 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-313212fa-8ff5-47d2-9996-98276b53a023 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=75d70ed2-6d91-4ff1-8c8f-039d41099611,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:56.279038 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-0b56eda9-17dd-44fe-81b1-05bd3e6d35b7 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Request body: {'security_group_rule': {'security_group_id': '9e3980a1-6cf9-4277-a78d-dd743d8d3bde', 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:56.303151 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.securitygroups_db [None req-0b56eda9-17dd-44fe-81b1-05bd3e6d35b7 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Project 1aefc80d27d3426daae57e2b0a4cbbbb added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 20 05:58:56.312747 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0b56eda9-17dd-44fe-81b1-05bd3e6d35b7 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.376870 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0b56eda9-17dd-44fe-81b1-05bd3e6d35b7 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.380950 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0b56eda9-17dd-44fe-81b1-05bd3e6d35b7 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.399207 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b56eda9-17dd-44fe-81b1-05bd3e6d35b7 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=82ed7a9f-624a-4cd2-871b-6eb17fa627aa,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:56.411798 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0b56eda9-17dd-44fe-81b1-05bd3e6d35b7 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.416112 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-0b56eda9-17dd-44fe-81b1-05bd3e6d35b7 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1380825 Dec 20 05:58:56.416565 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 48336) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:58:56.421179 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-6c57bf81-f00f-4a32-84c2-87956e4f3367 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Request body: {'security_group_rule': {'security_group_id': '9e3980a1-6cf9-4277-a78d-dd743d8d3bde', 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:58:56.445843 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.securitygroups_db [None req-6c57bf81-f00f-4a32-84c2-87956e4f3367 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Project 1aefc80d27d3426daae57e2b0a4cbbbb added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 20 05:58:56.453550 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-6c57bf81-f00f-4a32-84c2-87956e4f3367 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.520922 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-6c57bf81-f00f-4a32-84c2-87956e4f3367 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.525374 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-6c57bf81-f00f-4a32-84c2-87956e4f3367 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.545002 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c57bf81-f00f-4a32-84c2-87956e4f3367 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cd974a41-4fb4-46b1-874d-6627ea912a42,revision_number=0']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:56.557338 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-6c57bf81-f00f-4a32-84c2-87956e4f3367 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:56.562166 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-6c57bf81-f00f-4a32-84c2-87956e4f3367 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1444707 Dec 20 05:58:57.587025 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Sync routers for ids ['4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:58:57.597123 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Routers {'4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:57.597730 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:57.706476 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Set router 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:57.904879 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'name': 'tempest-TestVolumeBootPattern-714357623-router', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.131'}], 'enable_snat': True}, 'gw_port_id': '7269a2ab-2dd4-4b8b-b1bf-536003a0d27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T05:58:54Z', 'revision_number': 4, 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'gw_port': {'id': '7269a2ab-2dd4-4b8b-b1bf-536003a0d27b', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:c8:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T05:58:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'ebbdc4a9-0881-4586-8531-cde9c9ac026a', 'name': '', 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'mac_address': 'fa:16:3e:21:b1:94', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': 'ed59ecbe-71dc-425e-a0db-d530f6b7243d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:53Z', 'updated_at': '2021-12-20T05:58:54Z', 'revision_number': 2, 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'subnets': [{'id': 'ed59ecbe-71dc-425e-a0db-d530f6b7243d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:57.993618 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:58:58.040758 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Checking router: 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:58:58.041112 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Updating router 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 port ebbdc4a9-0881-4586-8531-cde9c9ac026a binding host dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 20 05:58:58.045884 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:58.046317 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:58.066983 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:58.135280 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:58.157208 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] For port 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=7269a2ab-2dd4-4b8b-b1bf-536003a0d27b,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:58.160538 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:58.209655 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Pushing event updated for resources: {'Port': ['ID=7269a2ab-2dd4-4b8b-b1bf-536003a0d27b,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:58.361581 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Publish callbacks [] for port, precommit_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:58.368278 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:58.418412 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d3013f-91e0-4d81-b56e-bb704fa7a187 None None] Pushing event updated for resources: {'Port': ['ID=ebbdc4a9-0881-4586-8531-cde9c9ac026a,revision_number=3']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:58.463663 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Attempting to bind port ebbdc4a9-0881-4586-8531-cde9c9ac026a on host dv-cinder-822278-1-iscsi for vnic_type normal with profile {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:58:58.464033 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Attempting to bind port ebbdc4a9-0881-4586-8531-cde9c9ac026a by drivers openvswitch,hyperv on host dv-cinder-822278-1-iscsi at level 0 using segments [{'id': '3dde54c0-d21a-4029-a188-85abe638860e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478'}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:58:58.464394 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Attempting to bind port ebbdc4a9-0881-4586-8531-cde9c9ac026a on network bc6ff48e-9cc3-4803-8a65-7ec1d02b5478 {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:58:58.469627 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Checking agent: {'id': '70b63dd9-6286-4759-bb13-be6b8635dd11', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-822278-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 45, 38), 'started_at': datetime.datetime(2021, 12, 20, 5, 46, 8), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 58, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-822278-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:58:58.469991 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Checking segment: {'id': '3dde54c0-d21a-4029-a188-85abe638860e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102448) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:58:58.470389 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:58.470774 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Bound using segment: {'id': '3dde54c0-d21a-4029-a188-85abe638860e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478'} {{(pid=102448) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:58:58.471232 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.managers [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Bound port: ebbdc4a9-0881-4586-8531-cde9c9ac026a, host: dv-cinder-822278-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3dde54c0-d21a-4029-a188-85abe638860e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478'}}] {{(pid=102448) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:58:58.471649 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:58.538661 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] For port ebbdc4a9-0881-4586-8531-cde9c9ac026a, host dv-cinder-822278-1-iscsi, cleared binding levels {{(pid=102448) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:58:58.542683 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.plugins.ml2.db [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] For port ebbdc4a9-0881-4586-8531-cde9c9ac026a, host dv-cinder-822278-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=ebbdc4a9-0881-4586-8531-cde9c9ac026a,segment=NetworkSegment(3dde54c0-d21a-4029-a188-85abe638860e),segment_id=3dde54c0-d21a-4029-a188-85abe638860e)] {{(pid=102448) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:58:58.547392 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron_lib.callbacks.manager [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102448) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:58.608676 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Routers {'4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:58:58.609741 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:58:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:58.611767 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d3013f-91e0-4d81-b56e-bb704fa7a187 None None] Pushing event updated for resources: {'Port': ['ID=ebbdc4a9-0881-4586-8531-cde9c9ac026a,revision_number=4']} {{(pid=102448) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:58.661946 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-83213272-b1db-496f-b5c3-c4e2ce79ece2 None None] Provisioning complete for port ebbdc4a9-0881-4586-8531-cde9c9ac026a triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:58.663423 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-83213272-b1db-496f-b5c3-c4e2ce79ece2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:58.739873 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] Set router 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:58:58.874963 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-83213272-b1db-496f-b5c3-c4e2ce79ece2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:58.906090 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-83213272-b1db-496f-b5c3-c4e2ce79ece2 None None] For port ebbdc4a9-0881-4586-8531-cde9c9ac026a, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=ebbdc4a9-0881-4586-8531-cde9c9ac026a,segment=NetworkSegment(3dde54c0-d21a-4029-a188-85abe638860e),segment_id=3dde54c0-d21a-4029-a188-85abe638860e)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:58:58.910213 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-83213272-b1db-496f-b5c3-c4e2ce79ece2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:58.944441 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'name': 'tempest-TestVolumeBootPattern-714357623-router', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.131'}], 'enable_snat': True}, 'gw_port_id': '7269a2ab-2dd4-4b8b-b1bf-536003a0d27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T05:58:54Z', 'revision_number': 4, 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'gw_port': {'id': '7269a2ab-2dd4-4b8b-b1bf-536003a0d27b', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:c8:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T05:58:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'ebbdc4a9-0881-4586-8531-cde9c9ac026a', 'name': '', 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'mac_address': 'fa:16:3e:21:b1:94', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': 'ed59ecbe-71dc-425e-a0db-d530f6b7243d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:53Z', 'updated_at': '2021-12-20T05:58:58Z', 'revision_number': 4, 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'subnets': [{'id': 'ed59ecbe-71dc-425e-a0db-d530f6b7243d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:58:58.959835 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83213272-b1db-496f-b5c3-c4e2ce79ece2 None None] Pushing event updated for resources: {'Port': ['ID=ebbdc4a9-0881-4586-8531-cde9c9ac026a,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:58:58.974228 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f0ef07a-e47b-4abf-a5e4-052e3909c045 None None] The sync data for ids ['4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'] in dv-cinder-822278-1-iscsi is: [{'id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'name': 'tempest-TestVolumeBootPattern-714357623-router', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.131'}], 'enable_snat': True}, 'gw_port_id': '7269a2ab-2dd4-4b8b-b1bf-536003a0d27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T05:58:54Z', 'revision_number': 4, 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'gw_port': {'id': '7269a2ab-2dd4-4b8b-b1bf-536003a0d27b', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:c8:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T05:58:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'ebbdc4a9-0881-4586-8531-cde9c9ac026a', 'name': '', 'network_id': 'bc6ff48e-9cc3-4803-8a65-7ec1d02b5478', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'mac_address': 'fa:16:3e:21:b1:94', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': 'ed59ecbe-71dc-425e-a0db-d530f6b7243d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:53Z', 'updated_at': '2021-12-20T05:58:58Z', 'revision_number': 4, 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'subnets': [{'id': 'ed59ecbe-71dc-425e-a0db-d530f6b7243d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:58:59.032516 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-1f25aa07-b8e6-4841-8973-17adf6ef309e None None] Provisioning complete for port ebbdc4a9-0881-4586-8531-cde9c9ac026a triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:58:59.033092 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-1f25aa07-b8e6-4841-8973-17adf6ef309e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:58:59.990312 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:59:00.047270 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:59:00.048007 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:00.131943 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device ebbdc4a9-0881-4586-8531-cde9c9ac026a up at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:59:00.180361 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Provisioning complete for port ebbdc4a9-0881-4586-8531-cde9c9ac026a triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:59:00.180777 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:01.722165 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f2a5d159-52ac-428b-8f6b-51ae696ce4f4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:04.151476 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-3fe3046b-b9bc-46ba-98c5-31aa1de1448c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:04.990838 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:06.478726 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:07.568256 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:08.019189 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951a741f-3ae4-4d82-a831-3a2c429afad7 req-14f3938f-74cb-4f75-a9db-470b476c6d8a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:08.020598 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-951a741f-3ae4-4d82-a831-3a2c429afad7 req-14f3938f-74cb-4f75-a9db-470b476c6d8a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0496283 Dec 20 05:59:08.068853 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-951a741f-3ae4-4d82-a831-3a2c429afad7 req-1381fbf2-235a-4a26-9139-b8f8f5c019ae tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415986 Dec 20 05:59:08.682175 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:09.188644 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5002aee-ab1c-4866-8fe2-aa869cf2d199 req-6135a68d-2cd7-40a5-879c-92818af9fd7e tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:09.190144 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f5002aee-ab1c-4866-8fe2-aa869cf2d199 req-6135a68d-2cd7-40a5-879c-92818af9fd7e tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0496345 Dec 20 05:59:09.242596 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f5002aee-ab1c-4866-8fe2-aa869cf2d199 req-b8c15f6a-12f3-413c-85a0-5e869ee8dc7e tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466719 Dec 20 05:59:10.356704 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77de3ed6-9b7b-437b-bb95-1d7fe9c3fcad req-ae1b0d39-e4b5-4b64-8894-f6da82b3eb45 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:10.358066 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-77de3ed6-9b7b-437b-bb95-1d7fe9c3fcad req-ae1b0d39-e4b5-4b64-8894-f6da82b3eb45 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0485711 Dec 20 05:59:10.406412 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-77de3ed6-9b7b-437b-bb95-1d7fe9c3fcad req-15c8b978-7246-4c08-9746-1643ab8e54b3 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426002 Dec 20 05:59:11.523326 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9bc8d7-812b-4076-ad12-6647e4878a91 req-bbbdb2d0-07bc-43fc-9e90-cf7c3ad4cf5b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:11.524871 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bc9bc8d7-812b-4076-ad12-6647e4878a91 req-bbbdb2d0-07bc-43fc-9e90-cf7c3ad4cf5b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0474155 Dec 20 05:59:11.572069 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bc9bc8d7-812b-4076-ad12-6647e4878a91 req-86c040d6-81c8-4d3f-9f64-7adcdbb17417 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409560 Dec 20 05:59:12.888212 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4985d523-96ca-4f70-9f59-07afd1905217 req-009edb95-137e-412e-8a23-df1a3019221b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:12.889587 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4985d523-96ca-4f70-9f59-07afd1905217 req-009edb95-137e-412e-8a23-df1a3019221b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.2478616 Dec 20 05:59:12.937298 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4985d523-96ca-4f70-9f59-07afd1905217 req-dbdbe8da-7671-4d61-b8bf-f753760ad23c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418549 Dec 20 05:59:14.059769 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84e42164-5985-419f-acc6-1f5f2908722b req-fe21cdde-d276-49b7-9ffe-32fe3c4c6ff0 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:14.061229 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-84e42164-5985-419f-acc6-1f5f2908722b req-fe21cdde-d276-49b7-9ffe-32fe3c4c6ff0 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0515907 Dec 20 05:59:14.108533 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-84e42164-5985-419f-acc6-1f5f2908722b req-1fb4f696-6220-42e6-811f-998256b044da tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415728 Dec 20 05:59:15.021349 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-b151a39d-f116-4285-9347-ef62da55daa6 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-487768033&fields=id&tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb HTTP/1.1" status: 200 len: 267 time: 0.0424709 Dec 20 05:59:15.143181 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-9b5e467e-4407-49ac-a62b-8a004ebd6592 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:15.144664 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-9b5e467e-4407-49ac-a62b-8a004ebd6592 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 812 time: 0.1163917 Dec 20 05:59:15.158900 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-54506dfa-78e9-4678-b9e7-c6522204d24c tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/quotas/1aefc80d27d3426daae57e2b0a4cbbbb HTTP/1.1" status: 200 len: 375 time: 0.0085516 Dec 20 05:59:15.209458 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-2abeafcc-23aa-416b-a624-262163371b9a tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0450976 Dec 20 05:59:15.275621 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd65f971-5561-40a6-b8a2-0958a25fc686 req-43809497-add9-40d0-af79-dcc49df87ef8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:15.277073 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bd65f971-5561-40a6-b8a2-0958a25fc686 req-43809497-add9-40d0-af79-dcc49df87ef8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0567689 Dec 20 05:59:15.340720 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bd65f971-5561-40a6-b8a2-0958a25fc686 req-ab9ad29c-92d8-4fe8-825c-a565f0bb5a83 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0576215 Dec 20 05:59:15.406038 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-792885d8-8ee0-4261-aa03-3d814fc517c7 service neutron] 10.222.0.46 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1839306 Dec 20 05:59:15.497736 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-e3f3691a-8a97-4bc3-bf4a-f553088e5942 service neutron] 10.222.0.46 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856123 Dec 20 05:59:15.773353 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ea97842a-66cd-4ff4-a999-4e46c9f54f56 req-fc7e5f06-518f-45f1-ab6c-20f0dbff4ff8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 210 time: 0.0264807 Dec 20 05:59:16.464006 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960b58be-baa2-4583-9d17-e3d0eed69446 req-47613272-ba9e-48df-8d35-72860069b7e8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:16.465485 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-960b58be-baa2-4583-9d17-e3d0eed69446 req-47613272-ba9e-48df-8d35-72860069b7e8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0555477 Dec 20 05:59:16.514881 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-960b58be-baa2-4583-9d17-e3d0eed69446 req-f291f42d-698a-4f4b-acd4-6630b4ea41b2 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434670 Dec 20 05:59:16.871926 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-827ca1d7-5aef-4fc8-80cb-614110794d17 req-3cfe3f50-ec3e-4186-b7cf-b4cd27e51ad0 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 210 time: 0.0248630 Dec 20 05:59:17.112379 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-3752fa93-4845-46c2-8897-66f9b337a882 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:17.113948 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-3752fa93-4845-46c2-8897-66f9b337a882 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 812 time: 0.1057096 Dec 20 05:59:17.192154 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-83dc70d3-c7ce-4eb3-9ef6-437547743c3d tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb HTTP/1.1" status: 200 len: 379 time: 0.0573404 Dec 20 05:59:17.205462 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Request body: {'port': {'device_id': '1c6183c8-bf08-4503-9eaf-a8e2a241a7c0', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'admin_state_up': True, 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'security_groups': ['9e3980a1-6cf9-4277-a78d-dd743d8d3bde']}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:59:17.314132 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Made reservation on behalf of 1aefc80d27d3426daae57e2b0a4cbbbb for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 05:59:17.317897 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:17.438880 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Allocated IP 172.20.0.6 (ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6/41d28c9a-6c88-4c21-87ff-6f5f781d2b3e/97c584e6-8c84-4348-b953-c84fc7440d6b) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:59:17.582516 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:17.648269 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22700cea-2b05-495c-887e-6d41811f3839 req-7241cb5d-3335-4b00-b94a-90963fedd9eb tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:17.649741 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-22700cea-2b05-495c-887e-6d41811f3839 req-7241cb5d-3335-4b00-b94a-90963fedd9eb tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0638425 Dec 20 05:59:17.662308 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:17.720528 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:59:17.728998 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:59:17.736118 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:59:17.752494 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'Port': ['ID=97c584e6-8c84-4348-b953-c84fc7440d6b,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:17.785526 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-22700cea-2b05-495c-887e-6d41811f3839 req-9950cb7b-3834-4995-a6fb-ac68afd75ce9 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1294820 Dec 20 05:59:17.790473 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:17.790823 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:17.791601 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:17.791601 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:17.791851 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:17.792155 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:17.792483 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:17.792827 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:17.793133 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:17.793459 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:17.793781 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:17.794100 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:17.794420 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:17.819553 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:17.820160 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:17.837177 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-19a5a09b-2896-4b87-8622-88e4bb15d630 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6356492 Dec 20 05:59:17.863466 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Request body: {'port': {'device_id': '1c6183c8-bf08-4503-9eaf-a8e2a241a7c0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:59:17.929671 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:17.963159 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-8dce04c2-e022-4825-9eec-96bc3841bbe4 None None] Provisioning complete for port 97c584e6-8c84-4348-b953-c84fc7440d6b triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:59:17.964804 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8dce04c2-e022-4825-9eec-96bc3841bbe4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:18.005394 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-8dce04c2-e022-4825-9eec-96bc3841bbe4 None None] Port 97c584e6-8c84-4348-b953-c84fc7440d6b cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 05:59:18.086727 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f28a81-a240-49fc-931c-a772fbeaac47 req-4551011e-eea6-4f75-9d73-f041f213de49 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:18.088288 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-44f28a81-a240-49fc-931c-a772fbeaac47 req-4551011e-eea6-4f75-9d73-f041f213de49 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 931 time: 0.1165280 Dec 20 05:59:18.193876 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-44f28a81-a240-49fc-931c-a772fbeaac47 req-889b44bd-928a-41bf-8dbe-8395c9509546 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0993702 Dec 20 05:59:18.276441 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 97c584e6-8c84-4348-b953-c84fc7440d6b {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:59:18.283682 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:18.295744 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Transition to ACTIVE for port object 97c584e6-8c84-4348-b953-c84fc7440d6b will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 05:59:18.298795 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:18.346115 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Pushing event updated for resources: {'Port': ['ID=97c584e6-8c84-4348-b953-c84fc7440d6b,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:18.387125 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f817eba4-453d-4269-b731-a772b0276542 req-bba6ddb0-b057-47ed-aba9-f2ba7832d878 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:18.388770 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-f817eba4-453d-4269-b731-a772b0276542 req-bba6ddb0-b057-47ed-aba9-f2ba7832d878 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a67a7ba727e54b1c9f6ca2d5ea21f272&device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 1098 time: 0.0460365 Dec 20 05:59:18.426688 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Attempting to bind port 97c584e6-8c84-4348-b953-c84fc7440d6b on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 05:59:18.427034 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Attempting to bind port 97c584e6-8c84-4348-b953-c84fc7440d6b by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 05:59:18.427345 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Attempting to bind port 97c584e6-8c84-4348-b953-c84fc7440d6b on network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:59:18.432640 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Port 97c584e6-8c84-4348-b953-c84fc7440d6b on network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 05:59:18.432966 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Attempting to bind port 97c584e6-8c84-4348-b953-c84fc7440d6b on network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 05:59:18.438034 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 5, 59, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 05:59:18.438368 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Checking segment: {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 05:59:18.440196 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Bound using segment: {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 05:59:18.440196 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Bound port: 97c584e6-8c84-4348-b953-c84fc7440d6b, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 05:59:18.440196 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:18.487160 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f817eba4-453d-4269-b731-a772b0276542 req-4a7f87a3-eb31-4f37-9511-5882d64cdab7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:18.489116 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-f817eba4-453d-4269-b731-a772b0276542 req-4a7f87a3-eb31-4f37-9511-5882d64cdab7 service neutron] 10.222.0.54 "GET /v2.0/networks?id=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 HTTP/1.1" status: 200 len: 910 time: 0.0921049 Dec 20 05:59:18.506938 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] For port 97c584e6-8c84-4348-b953-c84fc7440d6b, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 05:59:18.509992 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] For port 97c584e6-8c84-4348-b953-c84fc7440d6b, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=97c584e6-8c84-4348-b953-c84fc7440d6b,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 05:59:18.514639 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:18.555898 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:18.556514 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:18.557898 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] 10.222.0.54 "PUT /v2.0/ports/97c584e6-8c84-4348-b953-c84fc7440d6b HTTP/1.1" status: 200 len: 1093 time: 0.6988304 Dec 20 05:59:18.558343 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c6183c8-bf08-4503-9eaf-a8e2a241a7c0', 'tag': '97c584e6-8c84-4348-b953-c84fc7440d6b'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:59:18.560609 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7d127ca3-823d-48f3-a9f2-1ea3f7f1892c" -d '{"events": [{"name": "network-changed", "server_uuid": "1c6183c8-bf08-4503-9eaf-a8e2a241a7c0", "tag": "97c584e6-8c84-4348-b953-c84fc7440d6b"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:59:18.587683 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6746f4b-f715-49fd-9e03-efc1c86a77f6 service neutron] Pushing event updated for resources: {'Port': ['ID=97c584e6-8c84-4348-b953-c84fc7440d6b,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:18.612391 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-f817eba4-453d-4269-b731-a772b0276542 req-49b5b35a-86db-453e-9275-10c88224fa99 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=8a9f4386-7528-40a4-9b44-826be10f5c21 HTTP/1.1" status: 200 len: 1001 time: 0.0894742 Dec 20 05:59:18.677200 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f817eba4-453d-4269-b731-a772b0276542 req-a4659fba-3344-4b46-a4d7-b9628e38c75d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:18.677501 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-af47852e-b017-44c2-a0d5-262709b0f163 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:18.679610 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-af47852e-b017-44c2-a0d5-262709b0f163 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 1096 time: 0.0444877 Dec 20 05:59:18.679780 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-f817eba4-453d-4269-b731-a772b0276542 req-a4659fba-3344-4b46-a4d7-b9628e38c75d service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2b892f1-223d-4384-8544-8bbbbe5c621b HTTP/1.1" status: 200 len: 848 time: 0.0547655 Dec 20 05:59:18.686725 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:59:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4bfcbad9-1869-4548-9bf2-17555b959ec7 x-openstack-request-id: req-4bfcbad9-1869-4548-9bf2-17555b959ec7 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:59:18.687017 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c6183c8-bf08-4503-9eaf-a8e2a241a7c0", "tag": "97c584e6-8c84-4348-b953-c84fc7440d6b", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:59:18.687271 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-4bfcbad9-1869-4548-9bf2-17555b959ec7 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:59:18.687700 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c6183c8-bf08-4503-9eaf-a8e2a241a7c0', 'tag': '97c584e6-8c84-4348-b953-c84fc7440d6b', 'status': 'completed', 'code': 200} Dec 20 05:59:18.757063 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-0d915e51-854c-4643-b782-fe9013d7f1f2 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=97c584e6-8c84-4348-b953-c84fc7440d6b HTTP/1.1" status: 200 len: 217 time: 0.0359495 Dec 20 05:59:18.761867 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f817eba4-453d-4269-b731-a772b0276542 req-b3ff9803-730e-4cfd-8335-2c50576277cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:18.763353 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-f817eba4-453d-4269-b731-a772b0276542 req-b3ff9803-730e-4cfd-8335-2c50576277cd service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0416598 Dec 20 05:59:18.815852 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-e9708526-6d6c-496c-abaa-1d3db6d14cec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:18.817376 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-e9708526-6d6c-496c-abaa-1d3db6d14cec service neutron] 10.222.0.54 "GET /v2.0/subnets?id=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e HTTP/1.1" status: 200 len: 851 time: 0.0457888 Dec 20 05:59:18.863693 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-f817eba4-453d-4269-b731-a772b0276542 req-85c3d467-fff5-40ba-90e3-6f15686c0e65 service neutron] 10.222.0.54 "GET /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0914447 Dec 20 05:59:18.899003 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-6a12c505-5b5b-4573-a8ad-877205fc56c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:18.900536 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-6a12c505-5b5b-4573-a8ad-877205fc56c4 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0751193 Dec 20 05:59:18.917888 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a00b7095-479b-4443-924b-a6ecc580bb39 req-e0b77b8f-426e-4ef6-a48c-f9025249e6d4 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:18.919506 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a00b7095-479b-4443-924b-a6ecc580bb39 req-e0b77b8f-426e-4ef6-a48c-f9025249e6d4 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0608122 Dec 20 05:59:18.953671 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-f817eba4-453d-4269-b731-a772b0276542 req-8c07ce97-1145-48d3-a21b-b9a0e58219f6 service neutron] 10.222.0.54 "GET /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0814545 Dec 20 05:59:19.023163 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a00b7095-479b-4443-924b-a6ecc580bb39 req-b0503dbc-b019-4bc7-80e9-1b91dba4baed tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0966582 Dec 20 05:59:19.040533 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-325ad0d3-6ac1-4f4d-9d8d-11f3af04645a service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1312807 Dec 20 05:59:19.134423 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1fc92408-4dae-45d0-b667-fe0b90a5f8c3 req-019a824a-a1b9-48bd-8daa-321f0aa8e954 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848103 Dec 20 05:59:19.338641 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2444fe31-cbc0-4cef-9213-9cfbd6b4d0d2 req-9802af4c-0897-47ae-972b-118264884429 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:19.340153 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2444fe31-cbc0-4cef-9213-9cfbd6b4d0d2 req-9802af4c-0897-47ae-972b-118264884429 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 943 time: 0.0805829 Dec 20 05:59:19.345775 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d127ca3-823d-48f3-a9f2-1ea3f7f1892c req-d8e3e9c2-6a00-443e-891d-1628bf64fb4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:19.347155 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7d127ca3-823d-48f3-a9f2-1ea3f7f1892c req-d8e3e9c2-6a00-443e-891d-1628bf64fb4b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 1096 time: 0.0619223 Dec 20 05:59:19.438076 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2444fe31-cbc0-4cef-9213-9cfbd6b4d0d2 req-879424b6-5d0b-4a3c-b660-98ba2dc68573 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0899563 Dec 20 05:59:19.470668 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d127ca3-823d-48f3-a9f2-1ea3f7f1892c req-b448c834-1464-4675-b494-3211b31e2bcb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:19.472221 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7d127ca3-823d-48f3-a9f2-1ea3f7f1892c req-b448c834-1464-4675-b494-3211b31e2bcb service neutron] 10.222.0.54 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 913 time: 0.1079950 Dec 20 05:59:19.528726 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7d127ca3-823d-48f3-a9f2-1ea3f7f1892c req-29098c27-80f2-4e9c-8d76-5858c01378b3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=97c584e6-8c84-4348-b953-c84fc7440d6b HTTP/1.1" status: 200 len: 217 time: 0.0332785 Dec 20 05:59:19.579999 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d127ca3-823d-48f3-a9f2-1ea3f7f1892c req-6b984734-4e98-45e2-845f-b9cfaee6fcfa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:19.581377 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7d127ca3-823d-48f3-a9f2-1ea3f7f1892c req-6b984734-4e98-45e2-845f-b9cfaee6fcfa service neutron] 10.222.0.54 "GET /v2.0/subnets?id=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e HTTP/1.1" status: 200 len: 851 time: 0.0405810 Dec 20 05:59:19.629874 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d127ca3-823d-48f3-a9f2-1ea3f7f1892c req-fd782040-cddc-4545-ac9b-735d86d32d38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:19.631417 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7d127ca3-823d-48f3-a9f2-1ea3f7f1892c req-fd782040-cddc-4545-ac9b-735d86d32d38 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0382202 Dec 20 05:59:19.721926 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7d127ca3-823d-48f3-a9f2-1ea3f7f1892c req-2acc4d75-3ae9-435d-9f0e-8c50a74b216f service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813041 Dec 20 05:59:19.823865 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7d127ca3-823d-48f3-a9f2-1ea3f7f1892c req-0d351d5f-c1e3-4507-b956-299edd747e1f service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839469 Dec 20 05:59:20.149402 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3baeac3-3bc9-43ea-a104-08be88e30d5d req-9ee5be55-fab5-47cd-8b6d-388e981305b5 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:20.150935 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a3baeac3-3bc9-43ea-a104-08be88e30d5d req-9ee5be55-fab5-47cd-8b6d-388e981305b5 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0499442 Dec 20 05:59:20.202234 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a3baeac3-3bc9-43ea-a104-08be88e30d5d req-6645b449-f05a-47e4-9d76-9ae197fd3785 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452523 Dec 20 05:59:20.549539 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f96acf0-090c-4bda-87ea-a8e431993ee3 req-425d95fb-067e-48a3-8ebd-9cccd5a3719b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:20.550956 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3f96acf0-090c-4bda-87ea-a8e431993ee3 req-425d95fb-067e-48a3-8ebd-9cccd5a3719b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 943 time: 0.0464566 Dec 20 05:59:20.598291 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3f96acf0-090c-4bda-87ea-a8e431993ee3 req-a6538755-094f-490f-9605-5e9aabe87117 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413823 Dec 20 05:59:21.324147 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1064051f-8432-4716-9692-328d8a41e9be req-ae73f806-ad44-4757-8004-31b1f4bf4e8a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:21.325510 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1064051f-8432-4716-9692-328d8a41e9be req-ae73f806-ad44-4757-8004-31b1f4bf4e8a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0509768 Dec 20 05:59:21.375819 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1064051f-8432-4716-9692-328d8a41e9be req-46cc80e4-71b6-41c6-b62c-c0e091d165f0 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441306 Dec 20 05:59:21.712072 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5671a47-75e5-4716-870a-5d6bc1e51549 req-6692aa69-c37a-499a-a0f7-9539143e0c97 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:21.713767 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b5671a47-75e5-4716-870a-5d6bc1e51549 req-6692aa69-c37a-499a-a0f7-9539143e0c97 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 943 time: 0.0497744 Dec 20 05:59:21.761786 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b5671a47-75e5-4716-870a-5d6bc1e51549 req-3727b4da-7d3a-4c66-b837-00cdd1fd632f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421679 Dec 20 05:59:22.494866 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd306325-dd3d-4195-893f-9376879a4451 req-e0e55047-b309-4eec-88c4-6dcbf5fa40e9 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:22.496422 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fd306325-dd3d-4195-893f-9376879a4451 req-e0e55047-b309-4eec-88c4-6dcbf5fa40e9 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0544667 Dec 20 05:59:22.548321 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fd306325-dd3d-4195-893f-9376879a4451 req-7641d34f-0a3f-47d6-a885-bd56ba5eadd7 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456541 Dec 20 05:59:22.632726 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-838cee47-85b3-41ce-b882-7c8951795f77 req-92feb656-03d4-471b-a6f0-722c5e0f24d9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:22.634211 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-838cee47-85b3-41ce-b882-7c8951795f77 req-92feb656-03d4-471b-a6f0-722c5e0f24d9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0569429 Dec 20 05:59:22.663768 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [req-2648c301-9089-4538-ab25-fa2b937e1ae9 req-90ba680b-8d03-4fe5-aca6-103ceb027ac3 service neutron] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 05:59:22.664751 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2648c301-9089-4538-ab25-fa2b937e1ae9 req-90ba680b-8d03-4fe5-aca6-103ceb027ac3 service neutron] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0526819 Dec 20 05:59:22.688132 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-838cee47-85b3-41ce-b882-7c8951795f77 req-60b027cb-afda-484a-a934-460d1ca4a36b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480599 Dec 20 05:59:22.808833 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48636) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:22.817904 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84a6f80c-b269-44fa-ab53-f0c1db5491bc req-7fc59ef4-cfe8-4c4e-b639-1ad8502fec4b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:22.820631 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-84a6f80c-b269-44fa-ab53-f0c1db5491bc req-7fc59ef4-cfe8-4c4e-b639-1ad8502fec4b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0487752 Dec 20 05:59:22.879180 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-84a6f80c-b269-44fa-ab53-f0c1db5491bc req-762dd4ab-748f-4893-b477-d0404e84e4ac tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0524852 Dec 20 05:59:22.899702 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-0c6fac02-e8f1-498e-95c1-373561749f27 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0896580 Dec 20 05:59:22.908834 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-be9dee3b-526b-4ecc-9f25-1182e3c2891c service neutron] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102446) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 05:59:22.909893 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-be9dee3b-526b-4ecc-9f25-1182e3c2891c service neutron] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0051332 Dec 20 05:59:22.926415 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-934c92c0-3bba-461e-bcbf-bddd8e2240dd req-a5a42f50-562e-4dce-bc0b-c482171bb4b1 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:22.928570 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-934c92c0-3bba-461e-bcbf-bddd8e2240dd req-a5a42f50-562e-4dce-bc0b-c482171bb4b1 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 943 time: 0.0537884 Dec 20 05:59:22.977982 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-934c92c0-3bba-461e-bcbf-bddd8e2240dd req-2484bbda-6b81-4ce6-a593-96786a68c8d2 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432432 Dec 20 05:59:23.807765 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-237cc39e-15be-4dc0-b418-a497d642b30d req-d7d1569a-5777-4754-8c7b-0f5b85e7cf4f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:23.809218 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-237cc39e-15be-4dc0-b418-a497d642b30d req-d7d1569a-5777-4754-8c7b-0f5b85e7cf4f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0477293 Dec 20 05:59:23.859200 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-237cc39e-15be-4dc0-b418-a497d642b30d req-911b2501-ceed-4ad8-8946-bc5699bab6e6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440495 Dec 20 05:59:24.003216 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a245c4ff-1d0f-46ed-8640-752d346ae10b req-aeec26ad-eaa1-4398-a72a-f614eb03103d tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:24.004777 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a245c4ff-1d0f-46ed-8640-752d346ae10b req-aeec26ad-eaa1-4398-a72a-f614eb03103d tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0580885 Dec 20 05:59:24.103128 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a245c4ff-1d0f-46ed-8640-752d346ae10b req-bd3cbc98-46b8-4ce1-a35a-15d220f6803d tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0826459 Dec 20 05:59:24.130130 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17b784bd-d7ee-4fb7-adca-e689f04a0669 req-5945c76d-b331-47a5-b178-33e7d44a286a tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:24.131756 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-17b784bd-d7ee-4fb7-adca-e689f04a0669 req-5945c76d-b331-47a5-b178-33e7d44a286a tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 943 time: 0.0699525 Dec 20 05:59:24.187310 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-17b784bd-d7ee-4fb7-adca-e689f04a0669 req-f9b6e52d-24c8-4622-a69e-00170e9d8f8d tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476229 Dec 20 05:59:24.312434 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 8a9f4386-7528-40a4-9b44-826be10f5c21 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:59:24.389984 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:24.412628 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8a9f4386-7528-40a4-9b44-826be10f5c21'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:59:24.414852 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1ad60c69-99c1-4c53-9566-18421d751023" -d '{"events": [{"server_uuid": "7f092569-f7b1-4e5d-859b-95ab2173d63f", "name": "network-vif-unplugged", "status": "completed", "tag": "8a9f4386-7528-40a4-9b44-826be10f5c21"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:59:24.428295 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 8a9f4386-7528-40a4-9b44-826be10f5c21, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=8a9f4386-7528-40a4-9b44-826be10f5c21,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:24.434226 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:24.481878 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=8a9f4386-7528-40a4-9b44-826be10f5c21,revision_number=6']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:24.509802 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Mon, 20 Dec 2021 05:59:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ef3cabc7-c50a-429f-a3a6-bc7b69aa5eed x-openstack-request-id: req-ef3cabc7-c50a-429f-a3a6-bc7b69aa5eed {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:59:24.510127 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7f092569-f7b1-4e5d-859b-95ab2173d63f", "name": "network-vif-unplugged", "status": "completed", "tag": "8a9f4386-7528-40a4-9b44-826be10f5c21", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:59:24.510391 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-ef3cabc7-c50a-429f-a3a6-bc7b69aa5eed {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:59:24.510789 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'code': 200} Dec 20 05:59:24.643629 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-1390263c-9260-4fc9-b7a5-b3dc320fe149 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:24.645096 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-1390263c-9260-4fc9-b7a5-b3dc320fe149 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f&tenant_id=a67a7ba727e54b1c9f6ca2d5ea21f272 HTTP/1.1" status: 200 len: 1096 time: 0.0716057 Dec 20 05:59:24.720390 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-c1637b1b-7a86-4c34-bd56-5f530553d97b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:24.721828 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-c1637b1b-7a86-4c34-bd56-5f530553d97b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a67a7ba727e54b1c9f6ca2d5ea21f272&device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 1096 time: 0.0383232 Dec 20 05:59:24.813272 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-a04909a3-f4b1-468d-a5fd-ecf8ebaddb3e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:24.814636 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-a04909a3-f4b1-468d-a5fd-ecf8ebaddb3e service neutron] 10.222.0.54 "GET /v2.0/networks?id=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 HTTP/1.1" status: 200 len: 910 time: 0.0842452 Dec 20 05:59:24.881707 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-be411c14-f4f5-4f96-a9ff-ca17e0908a66 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=8a9f4386-7528-40a4-9b44-826be10f5c21 HTTP/1.1" status: 200 len: 999 time: 0.0591304 Dec 20 05:59:24.929934 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-7c7c0396-f398-44c4-a455-761e107f5085 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:24.931416 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-7c7c0396-f398-44c4-a455-761e107f5085 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2b892f1-223d-4384-8544-8bbbbe5c621b HTTP/1.1" status: 200 len: 848 time: 0.0423682 Dec 20 05:59:25.006163 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23130da-376d-4237-bf9f-4b798234c50d req-159ff7e6-32f5-45aa-bcb8-90120a9a99d9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:25.007653 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a23130da-376d-4237-bf9f-4b798234c50d req-159ff7e6-32f5-45aa-bcb8-90120a9a99d9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0752866 Dec 20 05:59:25.009949 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-7613b74f-bf0c-433a-8260-973ed659a962 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:25.011290 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-7613b74f-bf0c-433a-8260-973ed659a962 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0711884 Dec 20 05:59:25.103999 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a23130da-376d-4237-bf9f-4b798234c50d req-f05089a3-43e6-45f1-8c8d-418138a1b73a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0905418 Dec 20 05:59:25.127153 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-1c3967c3-1350-4ff3-8035-dd11bde96ca8 service neutron] 10.222.0.54 "GET /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1004007 Dec 20 05:59:25.244413 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bdc91ecf-7e3b-4541-997c-8eebff3d74c5 req-38855b69-f213-454b-8f4e-3a4c71951b92 service neutron] 10.222.0.54 "GET /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1098351 Dec 20 05:59:25.259539 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b40af5b-5dd2-4f13-893c-4f86d3fa8fd1 req-8c9a8ced-6af6-4a17-8e0e-063edf238407 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:25.261042 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2b40af5b-5dd2-4f13-893c-4f86d3fa8fd1 req-8c9a8ced-6af6-4a17-8e0e-063edf238407 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.0706673 Dec 20 05:59:25.341151 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-018ff699-55cd-4d4f-8768-e0f44c351e8b req-51af3ff9-046b-4d42-ab1a-31cdf8a0256a tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:25.342627 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-018ff699-55cd-4d4f-8768-e0f44c351e8b req-51af3ff9-046b-4d42-ab1a-31cdf8a0256a tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 943 time: 0.0807011 Dec 20 05:59:25.347681 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2b40af5b-5dd2-4f13-893c-4f86d3fa8fd1 req-d69d7d52-42c9-4280-8e24-786ec07b8e8e tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0760016 Dec 20 05:59:25.392809 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-018ff699-55cd-4d4f-8768-e0f44c351e8b req-44dd2686-e5dd-4ad2-b84a-c8d77124db89 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436678 Dec 20 05:59:26.221162 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7007d012-c6e4-4729-8fe8-33e3c33ac852 req-f168c52a-3112-49b5-8778-d732c9f1f39c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:26.222547 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7007d012-c6e4-4729-8fe8-33e3c33ac852 req-f168c52a-3112-49b5-8778-d732c9f1f39c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0477130 Dec 20 05:59:26.271660 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7007d012-c6e4-4729-8fe8-33e3c33ac852 req-f94cb477-61a6-4f6b-a640-c12c668309f7 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432801 Dec 20 05:59:26.466005 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3031b41-30a8-45a1-b147-64fde3a0f81c req-62a2d8e1-4d32-4b1a-bdde-a5281d39221d tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:26.467448 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f3031b41-30a8-45a1-b147-64fde3a0f81c req-62a2d8e1-4d32-4b1a-bdde-a5281d39221d tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.0508833 Dec 20 05:59:26.542234 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb28c717-9344-49fd-ad65-d543c39948c8 req-2ee54eaa-1f21-4a80-8247-3cf75d74d0db tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:26.543620 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fb28c717-9344-49fd-ad65-d543c39948c8 req-2ee54eaa-1f21-4a80-8247-3cf75d74d0db tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 943 time: 0.0752809 Dec 20 05:59:26.547488 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f3031b41-30a8-45a1-b147-64fde3a0f81c req-4b68b93f-1e9c-44a2-a4dc-916f677dfb90 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0710299 Dec 20 05:59:26.591398 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fb28c717-9344-49fd-ad65-d543c39948c8 req-9148fb40-28be-4412-a649-9b4a778ebefa tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418074 Dec 20 05:59:27.386134 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02507345-e134-432d-921c-acbe8acc3e69 req-4c17bdf4-0874-44e4-9115-dae17c3a56b7 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:27.387615 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-02507345-e134-432d-921c-acbe8acc3e69 req-4c17bdf4-0874-44e4-9115-dae17c3a56b7 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0460534 Dec 20 05:59:27.436502 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-02507345-e134-432d-921c-acbe8acc3e69 req-bf69f448-c58c-4377-b23d-2c83672fa54b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430074 Dec 20 05:59:27.659603 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-708d9665-c9c0-4477-bcda-bf9ee080ff29 req-574dd012-7317-4438-9430-53e56723e1bd tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:27.661068 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-708d9665-c9c0-4477-bcda-bf9ee080ff29 req-574dd012-7317-4438-9430-53e56723e1bd tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.0484819 Dec 20 05:59:27.735167 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ae1c47-33b5-4cdc-8527-a0860d37e82f req-7aff8bf4-658a-49bc-90b5-43ed4ac3afef tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:27.736664 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-23ae1c47-33b5-4cdc-8527-a0860d37e82f req-7aff8bf4-658a-49bc-90b5-43ed4ac3afef tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 943 time: 0.0747447 Dec 20 05:59:27.745946 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-708d9665-c9c0-4477-bcda-bf9ee080ff29 req-e01c48a9-7552-4b99-84c2-fe8a765cfaa0 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0752411 Dec 20 05:59:27.795756 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-23ae1c47-33b5-4cdc-8527-a0860d37e82f req-4c7daa79-0c91-481d-8c50-561731e804d2 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0488741 Dec 20 05:59:27.967455 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 05:59:28.326019 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 97c584e6-8c84-4348-b953-c84fc7440d6b details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:59:28.417844 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 97c584e6-8c84-4348-b953-c84fc7440d6b, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=97c584e6-8c84-4348-b953-c84fc7440d6b,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:28.428983 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '97c584e6-8c84-4348-b953-c84fc7440d6b', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'port_id': '97c584e6-8c84-4348-b953-c84fc7440d6b', 'mac_address': 'fa:16:3e:98:83:fe', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 448, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:59:28.468801 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:28.481539 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 97c584e6-8c84-4348-b953-c84fc7440d6b {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:59:28.500856 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 97c584e6-8c84-4348-b953-c84fc7440d6b, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=97c584e6-8c84-4348-b953-c84fc7440d6b,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:28.505257 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:28.553464 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=97c584e6-8c84-4348-b953-c84fc7440d6b,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:28.561495 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:28.561848 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:28.562214 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:28.562555 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:28.562885 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:28.563209 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:28.563561 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:28.563902 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:28.564211 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:28.564548 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:28.564873 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:28.565193 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:28.565514 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:28.754035 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91893333-05f0-4a62-93b8-f0557d1f5009 req-8fa82646-1cc6-4357-90fd-80d5b9e9e76b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:28.755565 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-91893333-05f0-4a62-93b8-f0557d1f5009 req-8fa82646-1cc6-4357-90fd-80d5b9e9e76b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.2476089 Dec 20 05:59:28.804165 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-91893333-05f0-4a62-93b8-f0557d1f5009 req-2fe0f45f-5431-453b-81fc-a818ad5125bd tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426958 Dec 20 05:59:28.869996 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea4b4f2-f1df-4e1c-8bec-770fe0b421c2 req-e6de5bc6-50d5-49aa-8dff-b5dd248ef19e tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:28.872184 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cea4b4f2-f1df-4e1c-8bec-770fe0b421c2 req-e6de5bc6-50d5-49aa-8dff-b5dd248ef19e tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.0556381 Dec 20 05:59:28.874559 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['97c584e6-8c84-4348-b953-c84fc7440d6b'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:59:28.953822 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3185a55e-626b-4481-97de-b8d88f96f2d2 req-f390e9e3-40b9-486e-a1d8-296722a67447 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:28.955403 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3185a55e-626b-4481-97de-b8d88f96f2d2 req-f390e9e3-40b9-486e-a1d8-296722a67447 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 944 time: 0.0823462 Dec 20 05:59:28.959606 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cea4b4f2-f1df-4e1c-8bec-770fe0b421c2 req-b78da0d8-985c-4f0e-bfdd-bc1eeeecca8b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0782564 Dec 20 05:59:29.009290 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3185a55e-626b-4481-97de-b8d88f96f2d2 req-a81bb01d-81c6-4732-a150-541835e6c653 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469148 Dec 20 05:59:29.924952 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-160e1094-816f-4ac1-99c7-6890d22152aa req-d1a43291-bfac-4367-b3e0-0ee9ede8a193 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:29.926422 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-160e1094-816f-4ac1-99c7-6890d22152aa req-d1a43291-bfac-4367-b3e0-0ee9ede8a193 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0479236 Dec 20 05:59:29.971965 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-160e1094-816f-4ac1-99c7-6890d22152aa req-a269b5f4-8272-4be3-a5d6-91d199ba3753 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396764 Dec 20 05:59:30.072862 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a9acd35-527f-4414-9c11-132b416eab39 req-4b669455-4f5e-4062-83cb-3eb1eedef19d tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:30.074332 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4a9acd35-527f-4414-9c11-132b416eab39 req-4b669455-4f5e-4062-83cb-3eb1eedef19d tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.0483351 Dec 20 05:59:30.148628 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4f561c1-c7d9-4418-863e-3cab064f9a26 req-71994392-acec-4eb9-9646-bcd4878c44ab tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:30.150073 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f4f561c1-c7d9-4418-863e-3cab064f9a26 req-71994392-acec-4eb9-9646-bcd4878c44ab tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 944 time: 0.0747240 Dec 20 05:59:30.158615 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4a9acd35-527f-4414-9c11-132b416eab39 req-48798f13-4365-42fe-abe2-25c06bee20e3 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0752439 Dec 20 05:59:30.202041 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f4f561c1-c7d9-4418-863e-3cab064f9a26 req-3deeff7c-87ba-4211-b599-f75e7f2ed11b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425081 Dec 20 05:59:30.326885 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 97c584e6-8c84-4348-b953-c84fc7440d6b up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:59:30.374705 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port 97c584e6-8c84-4348-b953-c84fc7440d6b completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 05:59:30.378444 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 97c584e6-8c84-4348-b953-c84fc7440d6b triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:59:30.378818 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:30.458107 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:30.479388 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c6183c8-bf08-4503-9eaf-a8e2a241a7c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '97c584e6-8c84-4348-b953-c84fc7440d6b'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:59:30.481595 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-15ba6358-7c66-4004-a25b-0a61f07fdfe2" -d '{"events": [{"server_uuid": "1c6183c8-bf08-4503-9eaf-a8e2a241a7c0", "name": "network-vif-plugged", "status": "completed", "tag": "97c584e6-8c84-4348-b953-c84fc7440d6b"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:59:30.494564 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 97c584e6-8c84-4348-b953-c84fc7440d6b, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=97c584e6-8c84-4348-b953-c84fc7440d6b,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:30.498672 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:30.521239 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:59:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12873d3d-4d6e-411c-bd02-199a15123fe1 x-openstack-request-id: req-12873d3d-4d6e-411c-bd02-199a15123fe1 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:59:30.521546 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c6183c8-bf08-4503-9eaf-a8e2a241a7c0", "name": "network-vif-plugged", "status": "completed", "tag": "97c584e6-8c84-4348-b953-c84fc7440d6b", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:59:30.521802 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-12873d3d-4d6e-411c-bd02-199a15123fe1 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:59:30.522184 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c6183c8-bf08-4503-9eaf-a8e2a241a7c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '97c584e6-8c84-4348-b953-c84fc7440d6b', 'code': 200} Dec 20 05:59:30.546131 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=97c584e6-8c84-4348-b953-c84fc7440d6b,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:30.793835 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bab4099-bad7-4610-a020-875b5c1d76bc req-ab292c1c-5db3-4008-88ee-0c8647108325 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:30.795178 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0bab4099-bad7-4610-a020-875b5c1d76bc req-ab292c1c-5db3-4008-88ee-0c8647108325 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 1098 time: 0.0381150 Dec 20 05:59:30.840388 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0bab4099-bad7-4610-a020-875b5c1d76bc req-4192c0d6-8869-4d45-ba91-172663940515 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0372698 Dec 20 05:59:31.093851 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a366f7-ffd7-411f-a0f5-347327f10873 req-fa8fe554-60b7-4d91-9475-64ce213b419f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:31.095227 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f5a366f7-ffd7-411f-a0f5-347327f10873 req-fa8fe554-60b7-4d91-9475-64ce213b419f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0517852 Dec 20 05:59:31.140329 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f5a366f7-ffd7-411f-a0f5-347327f10873 req-4a0452fc-c1fc-4437-aa64-8b419129ef4e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392921 Dec 20 05:59:31.285321 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc2e4e81-cb52-4ef2-a1ad-66621e61041e req-1bb07c8e-e3d4-486c-b288-9b2fce509adc tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:31.286729 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bc2e4e81-cb52-4ef2-a1ad-66621e61041e req-1bb07c8e-e3d4-486c-b288-9b2fce509adc tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.0579939 Dec 20 05:59:31.346495 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e2f0e3-481f-4ddb-85ea-cac64d62af42 req-765d05ba-e530-4db7-9881-ef11f47f34b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:31.347913 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-66e2f0e3-481f-4ddb-85ea-cac64d62af42 req-765d05ba-e530-4db7-9881-ef11f47f34b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 945 time: 0.0780888 Dec 20 05:59:31.378062 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bc2e4e81-cb52-4ef2-a1ad-66621e61041e req-cd4dd906-3a39-4d1e-8d90-13f462129107 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0746939 Dec 20 05:59:31.409690 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-66e2f0e3-481f-4ddb-85ea-cac64d62af42 req-76e4b783-6ed6-4705-9452-e6513baf602b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0542700 Dec 20 05:59:31.714893 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-fb572b50-cf45-41cc-8c70-91381a3f1496 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:32.269764 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e39e502-d73a-4ed2-95aa-7ad969cad6d2 req-30832002-fdac-49d7-af5e-08ed3d2a3691 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:32.271892 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9e39e502-d73a-4ed2-95aa-7ad969cad6d2 req-30832002-fdac-49d7-af5e-08ed3d2a3691 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0492129 Dec 20 05:59:32.327371 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9e39e502-d73a-4ed2-95aa-7ad969cad6d2 req-40330ba9-bd77-4a24-b3db-d57aa5fc60e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0487747 Dec 20 05:59:32.522198 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a69cee1-0cb7-46d9-b108-4b942072ab59 req-31e636cf-280f-4ab7-82b7-1dcdc2ea8eca tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:32.523814 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0a69cee1-0cb7-46d9-b108-4b942072ab59 req-31e636cf-280f-4ab7-82b7-1dcdc2ea8eca tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.0767164 Dec 20 05:59:32.555628 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f884b6a3-4747-4bab-ab82-dcdd046f3bca req-8bf92e89-a852-45fd-a013-b8439c0be193 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:32.557074 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f884b6a3-4747-4bab-ab82-dcdd046f3bca req-8bf92e89-a852-45fd-a013-b8439c0be193 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 945 time: 0.0768645 Dec 20 05:59:32.602578 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0a69cee1-0cb7-46d9-b108-4b942072ab59 req-3d497c3b-2fb7-4b15-8ca7-c45efd059e2f tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0714183 Dec 20 05:59:32.633409 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f884b6a3-4747-4bab-ab82-dcdd046f3bca req-31627aeb-803d-4c5c-9c83-aae632c9f24d tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0658674 Dec 20 05:59:32.746050 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d394358-f481-4305-aabb-8d3e2a0a98ab req-117faf11-fa5a-4803-a0d4-b7e4c737b183 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:32.747419 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3d394358-f481-4305-aabb-8d3e2a0a98ab req-117faf11-fa5a-4803-a0d4-b7e4c737b183 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 945 time: 0.0473897 Dec 20 05:59:32.795716 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3d394358-f481-4305-aabb-8d3e2a0a98ab req-1e37edbb-16c0-4657-9e69-cfe27be37a06 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424674 Dec 20 05:59:32.817021 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 48736) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:32.899571 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16550099-eb4d-4441-97bd-d26152f714f0 tempest-TestVolumeBootPattern-384334718 tempest-TestVolumeBootPattern-384334718-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:32.902553 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-16550099-eb4d-4441-97bd-d26152f714f0 tempest-TestVolumeBootPattern-384334718 tempest-TestVolumeBootPattern-384334718-project-admin] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 1093 time: 0.0845728 Dec 20 05:59:32.905420 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 48740) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:32.909665 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Request body: {'floatingip': {'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'port_id': '97c584e6-8c84-4348-b953-c84fc7440d6b', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address': '172.20.0.6'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:59:32.932583 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for floatingip, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:33.037668 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:33.147639 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Allocated IP 172.27.3.172 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/441d1d30-3166-469a-8aa6-407b4f6a3c2e) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 05:59:33.251708 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:33.286303 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:33.331362 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 05:59:33.334248 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 05:59:33.337638 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 05:59:33.343041 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'Port': ['ID=441d1d30-3166-469a-8aa6-407b4f6a3c2e,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:33.544619 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-527da78a-335b-436a-b7f2-8145b97d050b req-f2ab499b-2270-4ead-b55c-54dc30a32571 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:33.546011 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-527da78a-335b-436a-b7f2-8145b97d050b req-f2ab499b-2270-4ead-b55c-54dc30a32571 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.1275759 Dec 20 05:59:33.640967 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-527da78a-335b-436a-b7f2-8145b97d050b req-41fa59f5-2482-4bbd-b658-d17676dc5ffa tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0886123 Dec 20 05:59:33.795316 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7fb6290-a212-4dc8-80a4-9e7b48cf70f1 req-a5ef01ff-ad2b-47b4-aac6-bb865dafa92b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:33.796742 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c7fb6290-a212-4dc8-80a4-9e7b48cf70f1 req-a5ef01ff-ad2b-47b4-aac6-bb865dafa92b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 943 time: 0.1149430 Dec 20 05:59:33.854193 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:33.861275 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c7fb6290-a212-4dc8-80a4-9e7b48cf70f1 req-8534e3e3-4d1d-4d17-a1e8-a3b7436b5ed6 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0581450 Dec 20 05:59:33.926540 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:34.072070 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:34.076196 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:34.142654 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'Port': ['ID=441d1d30-3166-469a-8aa6-407b4f6a3c2e,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:34.152214 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-101cc243-e07e-45f4-8002-f122976f1a2d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:34.152728 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:34.253970 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.l3_db [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Floating IP 558b2a25-bb66-4ad7-bc1f-d0f3e9911d3d associated. External IP: 172.27.3.172, port: 97c584e6-8c84-4348-b953-c84fc7440d6b. Dec 20 05:59:34.330601 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 8a9f4386-7528-40a4-9b44-826be10f5c21 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:59:34.422806 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 8a9f4386-7528-40a4-9b44-826be10f5c21, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=8a9f4386-7528-40a4-9b44-826be10f5c21,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:34.433627 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'port_id': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'mac_address': 'fa:16:3e:ec:ca:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 407, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:59:34.464387 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Router 8700450f-8a60-4f59-88d0-7c64696c2fae has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:59:34.476326 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:34.489352 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8a9f4386-7528-40a4-9b44-826be10f5c21 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:59:34.508272 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 8a9f4386-7528-40a4-9b44-826be10f5c21, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=8a9f4386-7528-40a4-9b44-826be10f5c21,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:34.513231 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:34.563598 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=8a9f4386-7528-40a4-9b44-826be10f5c21,revision_number=7']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:34.577898 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:59:34.589255 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3fd4d343-02d4-49b5-8272-8bbb525a9585 None None] Sync routers for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:59:34.602121 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3fd4d343-02d4-49b5-8272-8bbb525a9585 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:59:34.602748 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-3fd4d343-02d4-49b5-8272-8bbb525a9585 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:59:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:34.607935 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:34.720351 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-3fd4d343-02d4-49b5-8272-8bbb525a9585 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:59:34.870793 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-ed617341-772a-4c39-b382-03dd34b88791 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9643397 Dec 20 05:59:34.872088 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c6183c8-bf08-4503-9eaf-a8e2a241a7c0', 'tag': '97c584e6-8c84-4348-b953-c84fc7440d6b'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:59:34.873508 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['8a9f4386-7528-40a4-9b44-826be10f5c21'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:59:34.874325 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-943bb347-1e00-496f-abef-3b2ff5d80f4a" -d '{"events": [{"name": "network-changed", "server_uuid": "1c6183c8-bf08-4503-9eaf-a8e2a241a7c0", "tag": "97c584e6-8c84-4348-b953-c84fc7440d6b"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:59:34.905279 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95fcd718-fbc7-4892-bf8e-53a6421c0e1d req-19a5126f-35c3-466e-bd15-14bed418528e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:34.906644 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-95fcd718-fbc7-4892-bf8e-53a6421c0e1d req-19a5126f-35c3-466e-bd15-14bed418528e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0684793 Dec 20 05:59:34.929048 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:59:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ba020cb-1927-4a14-bfa1-17bc13283865 x-openstack-request-id: req-1ba020cb-1927-4a14-bfa1-17bc13283865 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:59:34.929403 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c6183c8-bf08-4503-9eaf-a8e2a241a7c0", "tag": "97c584e6-8c84-4348-b953-c84fc7440d6b", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:59:34.929720 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-1ba020cb-1927-4a14-bfa1-17bc13283865 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:59:34.930168 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c6183c8-bf08-4503-9eaf-a8e2a241a7c0', 'tag': '97c584e6-8c84-4348-b953-c84fc7440d6b', 'status': 'completed', 'code': 200} Dec 20 05:59:34.969575 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-95fcd718-fbc7-4892-bf8e-53a6421c0e1d req-662ad24a-dba1-4c97-94fa-e99ba4030640 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0563154 Dec 20 05:59:35.037828 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:35.056486 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943bb347-1e00-496f-abef-3b2ff5d80f4a req-23b8a670-9fe3-4344-b812-0525fae31c83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:35.057980 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-943bb347-1e00-496f-abef-3b2ff5d80f4a req-23b8a670-9fe3-4344-b812-0525fae31c83 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 1098 time: 0.0753570 Dec 20 05:59:35.070229 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49477815-0938-4c56-9f07-ac52469ec1ac req-9e7434a6-36dc-4848-b35b-b23c4dcd02cc tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:35.071640 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-49477815-0938-4c56-9f07-ac52469ec1ac req-9e7434a6-36dc-4848-b35b-b23c4dcd02cc tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 944 time: 0.0781596 Dec 20 05:59:35.132061 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-3fd4d343-02d4-49b5-8272-8bbb525a9585 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '558b2a25-bb66-4ad7-bc1f-d0f3e9911d3d', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.172', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '97c584e6-8c84-4348-b953-c84fc7440d6b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 576, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:98:83:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c6183c8-bf08-4503-9eaf-a8e2a241a7c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:59:33Z', 'updated_at': '2021-12-20T05:59:33Z', 'revision_number': 0, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:35.168360 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3fd4d343-02d4-49b5-8272-8bbb525a9585 None None] Checking router: 8700450f-8a60-4f59-88d0-7c64696c2fae for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:59:35.175746 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-49477815-0938-4c56-9f07-ac52469ec1ac req-fdd16ccf-91c1-4f79-ba6a-9694fbf11af8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0957315 Dec 20 05:59:35.196786 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3fd4d343-02d4-49b5-8272-8bbb525a9585 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:59:35.196786 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-3fd4d343-02d4-49b5-8272-8bbb525a9585 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:59:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:35.197068 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943bb347-1e00-496f-abef-3b2ff5d80f4a req-2a479259-bb54-42db-8f23-6d216905fb8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:35.197068 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-943bb347-1e00-496f-abef-3b2ff5d80f4a req-2a479259-bb54-42db-8f23-6d216905fb8f service neutron] 10.222.0.54 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 913 time: 0.1223714 Dec 20 05:59:35.260434 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-943bb347-1e00-496f-abef-3b2ff5d80f4a req-a56dd64a-857b-4d99-94b5-103706e778bd service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=97c584e6-8c84-4348-b953-c84fc7440d6b HTTP/1.1" status: 200 len: 999 time: 0.0580409 Dec 20 05:59:35.311278 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943bb347-1e00-496f-abef-3b2ff5d80f4a req-3f03a30a-cbe1-4d0c-abba-222009b1d6d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:35.312681 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-943bb347-1e00-496f-abef-3b2ff5d80f4a req-3f03a30a-cbe1-4d0c-abba-222009b1d6d1 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e HTTP/1.1" status: 200 len: 851 time: 0.0445273 Dec 20 05:59:35.364893 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943bb347-1e00-496f-abef-3b2ff5d80f4a req-0a90bb77-e797-4216-9ffb-10f81ffa822d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:35.366440 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-943bb347-1e00-496f-abef-3b2ff5d80f4a req-0a90bb77-e797-4216-9ffb-10f81ffa822d service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0460103 Dec 20 05:59:35.459284 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-943bb347-1e00-496f-abef-3b2ff5d80f4a req-4fb6d314-fb72-4387-9f27-757c668c9cfe service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840678 Dec 20 05:59:35.473361 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-3fd4d343-02d4-49b5-8272-8bbb525a9585 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:59:35.554700 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-943bb347-1e00-496f-abef-3b2ff5d80f4a req-e79c6aa4-c6cd-4bf4-b02b-ff5a52753f67 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887525 Dec 20 05:59:35.705563 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-3fd4d343-02d4-49b5-8272-8bbb525a9585 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '558b2a25-bb66-4ad7-bc1f-d0f3e9911d3d', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.172', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '97c584e6-8c84-4348-b953-c84fc7440d6b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 576, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:98:83:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c6183c8-bf08-4503-9eaf-a8e2a241a7c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:59:33Z', 'updated_at': '2021-12-20T05:59:33Z', 'revision_number': 0, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:35.735240 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3fd4d343-02d4-49b5-8272-8bbb525a9585 None None] The sync data for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi is: [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '558b2a25-bb66-4ad7-bc1f-d0f3e9911d3d', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.172', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '97c584e6-8c84-4348-b953-c84fc7440d6b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 576, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:98:83:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c6183c8-bf08-4503-9eaf-a8e2a241a7c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T05:59:33Z', 'updated_at': '2021-12-20T05:59:33Z', 'revision_number': 0, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:59:35.916710 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a80fc0b9-72dd-41e4-b2e3-20fa10389ca1 None None] New status for floating IP 558b2a25-bb66-4ad7-bc1f-d0f3e9911d3d: ACTIVE {{(pid=102448) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 05:59:36.103459 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff8b7bf-6a1b-4b05-afe6-fb4f2d2d3ff8 req-7a795c4f-3acb-4075-a040-4742fd0851d8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:36.105141 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9ff8b7bf-6a1b-4b05-afe6-fb4f2d2d3ff8 req-7a795c4f-3acb-4075-a040-4742fd0851d8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0629237 Dec 20 05:59:36.151378 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9ff8b7bf-6a1b-4b05-afe6-fb4f2d2d3ff8 req-96586c55-e335-4d97-9b3c-33926c024800 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401804 Dec 20 05:59:36.294080 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f43ac64-16b1-4ce6-a18a-1deaa91a92a2 req-7ead219e-b39c-4f37-bc80-36a54cbd1f00 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:36.295464 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0f43ac64-16b1-4ce6-a18a-1deaa91a92a2 req-7ead219e-b39c-4f37-bc80-36a54cbd1f00 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 944 time: 0.0489612 Dec 20 05:59:36.342238 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 8a9f4386-7528-40a4-9b44-826be10f5c21 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:59:36.346651 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0f43ac64-16b1-4ce6-a18a-1deaa91a92a2 req-88458814-f92b-4277-a1d8-58c17a42cee7 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453227 Dec 20 05:59:36.389472 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 8a9f4386-7528-40a4-9b44-826be10f5c21 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:59:36.389844 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:36.475457 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:36.490820 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:36.501581 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a9f4386-7528-40a4-9b44-826be10f5c21'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:59:36.503838 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-305022cf-8589-4e8f-969d-c99b3a8e8c5c" -d '{"events": [{"server_uuid": "7f092569-f7b1-4e5d-859b-95ab2173d63f", "name": "network-vif-plugged", "status": "completed", "tag": "8a9f4386-7528-40a4-9b44-826be10f5c21"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:59:36.516590 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 8a9f4386-7528-40a4-9b44-826be10f5c21, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=8a9f4386-7528-40a4-9b44-826be10f5c21,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:36.520553 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:36.544904 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:59:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc81c862-4b2f-4ea9-b268-d313454e44a1 x-openstack-request-id: req-cc81c862-4b2f-4ea9-b268-d313454e44a1 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:59:36.545185 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7f092569-f7b1-4e5d-859b-95ab2173d63f", "name": "network-vif-plugged", "status": "completed", "tag": "8a9f4386-7528-40a4-9b44-826be10f5c21", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:59:36.545423 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-cc81c862-4b2f-4ea9-b268-d313454e44a1 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:59:36.545806 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'code': 200} Dec 20 05:59:36.569940 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=8a9f4386-7528-40a4-9b44-826be10f5c21,revision_number=8']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:36.875000 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5f29c1e-6595-42d5-9220-d93ca610cb03 req-208f66f3-343a-4b30-b2c6-ac7ebf91a692 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:36.876485 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b5f29c1e-6595-42d5-9220-d93ca610cb03 req-208f66f3-343a-4b30-b2c6-ac7ebf91a692 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 1098 time: 0.0382144 Dec 20 05:59:36.921474 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b5f29c1e-6595-42d5-9220-d93ca610cb03 req-250f0bcd-afde-4b74-9770-69987376def1 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373061 Dec 20 05:59:37.268506 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd46d8d3-37f2-4886-bc86-e453c37d88f2 req-551c4d55-9f75-425b-8930-be3fe7be6f40 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:37.270084 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dd46d8d3-37f2-4886-bc86-e453c37d88f2 req-551c4d55-9f75-425b-8930-be3fe7be6f40 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0483708 Dec 20 05:59:37.319835 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dd46d8d3-37f2-4886-bc86-e453c37d88f2 req-57e9ddba-a05c-415e-b3d2-62c9b2bece05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432038 Dec 20 05:59:37.464881 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d034179-a363-4c47-be33-20372c8f66a2 req-3efa7403-1081-4302-ae85-b50b913c7e4e tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:37.466292 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5d034179-a363-4c47-be33-20372c8f66a2 req-3efa7403-1081-4302-ae85-b50b913c7e4e tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0513937 Dec 20 05:59:37.513973 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5d034179-a363-4c47-be33-20372c8f66a2 req-28ce6199-c09a-4854-8ec9-0395ffe85087 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418336 Dec 20 05:59:37.571615 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:38.436056 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa340698-ade8-481a-b22f-35e30b54dd64 req-363066bb-ba6d-4459-a7a9-c2d064865464 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:38.437512 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fa340698-ade8-481a-b22f-35e30b54dd64 req-363066bb-ba6d-4459-a7a9-c2d064865464 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0484567 Dec 20 05:59:38.483035 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fa340698-ade8-481a-b22f-35e30b54dd64 req-9e9680f9-57a2-43c3-b744-d7038a2295c8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396471 Dec 20 05:59:38.627026 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ffa26c-f197-44de-9b16-6d64f6d1b46b req-c3275ce9-bc07-4b3a-8b88-77a41e565320 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:38.628516 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b0ffa26c-f197-44de-9b16-6d64f6d1b46b req-c3275ce9-bc07-4b3a-8b88-77a41e565320 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0472531 Dec 20 05:59:38.676203 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:38.680817 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b0ffa26c-f197-44de-9b16-6d64f6d1b46b req-0207e8ef-fef0-4e2f-b119-aee76bbb3d06 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457804 Dec 20 05:59:39.601236 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d533c7-cd1c-45b6-9dc2-d825a5d41b1e req-127b516e-907b-45de-b66b-6a6337e5dddb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:39.602693 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58d533c7-cd1c-45b6-9dc2-d825a5d41b1e req-127b516e-907b-45de-b66b-6a6337e5dddb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0481460 Dec 20 05:59:39.648998 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58d533c7-cd1c-45b6-9dc2-d825a5d41b1e req-049879cf-4252-4452-9236-77948cd64af3 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404265 Dec 20 05:59:40.336533 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bfa53477-80cc-4257-84e9-7d8adb9ac0f8 req-bdfa389b-1cf9-4465-8a30-3f570719c91d service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0380394 Dec 20 05:59:40.383454 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 9e825da9-eb60-4572-8a89-92caa8cddaa2 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 05:59:40.429035 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfa53477-80cc-4257-84e9-7d8adb9ac0f8 req-449e7c26-66ec-4b66-ada1-0a2e8e6bd983 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:40.430522 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bfa53477-80cc-4257-84e9-7d8adb9ac0f8 req-449e7c26-66ec-4b66-ada1-0a2e8e6bd983 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=627c52664e194163a380283ded298eb5&device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 1137 time: 0.0469325 Dec 20 05:59:40.483364 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 9e825da9-eb60-4572-8a89-92caa8cddaa2, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:40.494116 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'port_id': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'mac_address': 'fa:16:3e:0a:87:10', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 414, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 05:59:40.529790 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:40.542676 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 9e825da9-eb60-4572-8a89-92caa8cddaa2 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 05:59:40.545893 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfa53477-80cc-4257-84e9-7d8adb9ac0f8 req-8cb50744-d165-4702-940c-2902fabac87b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:40.547358 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bfa53477-80cc-4257-84e9-7d8adb9ac0f8 req-8cb50744-d165-4702-940c-2902fabac87b service neutron] 10.222.0.54 "GET /v2.0/networks?id=4e35b188-ad5c-4cae-9209-b7e538e3669f HTTP/1.1" status: 200 len: 916 time: 0.0829062 Dec 20 05:59:40.561076 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 9e825da9-eb60-4572-8a89-92caa8cddaa2, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:40.565224 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:40.614247 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=9e825da9-eb60-4572-8a89-92caa8cddaa2,revision_number=6']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:40.617421 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bfa53477-80cc-4257-84e9-7d8adb9ac0f8 req-6cb04f4b-9bc0-4704-b933-848624465245 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=18320379-21ed-4b2e-af2c-62b95cf39325 HTTP/1.1" status: 200 len: 1000 time: 0.0608587 Dec 20 05:59:40.669637 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfa53477-80cc-4257-84e9-7d8adb9ac0f8 req-2e1fd479-d878-409a-8c00-4d6a137a350b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:40.671036 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bfa53477-80cc-4257-84e9-7d8adb9ac0f8 req-2e1fd479-d878-409a-8c00-4d6a137a350b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fca5c9c5-06df-4c64-840c-e8558a30dd3c HTTP/1.1" status: 200 len: 854 time: 0.0427349 Dec 20 05:59:40.779758 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfa53477-80cc-4257-84e9-7d8adb9ac0f8 req-3d0d7398-48d6-4e3f-9422-da6744f56947 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:40.781250 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bfa53477-80cc-4257-84e9-7d8adb9ac0f8 req-3d0d7398-48d6-4e3f-9422-da6744f56947 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4e35b188-ad5c-4cae-9209-b7e538e3669f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0649974 Dec 20 05:59:40.796139 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e58988b0-45cb-4855-bfd0-03d732492566 req-a6ab0411-45e8-4ad7-8202-55ef9e8d09c6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:40.797493 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e58988b0-45cb-4855-bfd0-03d732492566 req-a6ab0411-45e8-4ad7-8202-55ef9e8d09c6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 945 time: 0.0586236 Dec 20 05:59:40.830843 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['9e825da9-eb60-4572-8a89-92caa8cddaa2'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:59:40.899332 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e58988b0-45cb-4855-bfd0-03d732492566 req-1cf81060-d548-4076-9262-04b8bc816e1e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0959492 Dec 20 05:59:40.926885 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bfa53477-80cc-4257-84e9-7d8adb9ac0f8 req-fb101719-c569-4eca-885a-3d7fcf4a6c4c service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1070342 Dec 20 05:59:41.035505 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bfa53477-80cc-4257-84e9-7d8adb9ac0f8 req-427d6be8-6b4d-45bb-9efc-08ceec1572fe service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1014862 Dec 20 05:59:42.096038 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23c8237b-a3ab-4488-9e7d-a7cfcfa8f1d8 req-0e3de620-2c7f-4580-8e75-71f0cd6ab521 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:42.097703 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-23c8237b-a3ab-4488-9e7d-a7cfcfa8f1d8 req-0e3de620-2c7f-4580-8e75-71f0cd6ab521 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 945 time: 0.0896692 Dec 20 05:59:42.163310 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-23c8237b-a3ab-4488-9e7d-a7cfcfa8f1d8 req-7b0ad390-f2d7-4805-9fc4-87bb1e0712ab tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0592058 Dec 20 05:59:42.400697 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 9e825da9-eb60-4572-8a89-92caa8cddaa2 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 05:59:42.457484 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 9e825da9-eb60-4572-8a89-92caa8cddaa2 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:59:42.458159 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:42.542438 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:42.571411 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e825da9-eb60-4572-8a89-92caa8cddaa2'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:59:42.573847 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46c0ed89-6a02-40dc-97a3-138b5f579911" -d '{"events": [{"server_uuid": "8e0ee236-8474-4f2a-b875-752d3dec628f", "name": "network-vif-plugged", "status": "completed", "tag": "9e825da9-eb60-4572-8a89-92caa8cddaa2"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:59:42.588080 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 9e825da9-eb60-4572-8a89-92caa8cddaa2, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:42.592905 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:42.636060 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:59:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3483a43d-c74d-43f1-9deb-0f4d255f5d62 x-openstack-request-id: req-3483a43d-c74d-43f1-9deb-0f4d255f5d62 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:59:42.636503 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8e0ee236-8474-4f2a-b875-752d3dec628f", "name": "network-vif-plugged", "status": "completed", "tag": "9e825da9-eb60-4572-8a89-92caa8cddaa2", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:59:42.636850 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-3483a43d-c74d-43f1-9deb-0f4d255f5d62 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:59:42.637339 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'code': 200} Dec 20 05:59:42.665425 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=9e825da9-eb60-4572-8a89-92caa8cddaa2,revision_number=7']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:43.291076 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-493b615f-28e9-4a1d-8c44-de18a8ced8fb req-ca972c62-13d4-414b-814a-62ad706a663a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:43.292694 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-493b615f-28e9-4a1d-8c44-de18a8ced8fb req-ca972c62-13d4-414b-814a-62ad706a663a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0529232 Dec 20 05:59:43.354050 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-493b615f-28e9-4a1d-8c44-de18a8ced8fb req-a3a30332-9429-4256-a99f-a86d75b92ac2 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0534887 Dec 20 05:59:44.496465 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36b07f8b-6450-4ab3-a824-8e737fc8af0d req-7b614733-4aec-403e-8da7-d50fed4dd620 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:44.498063 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-36b07f8b-6450-4ab3-a824-8e737fc8af0d req-7b614733-4aec-403e-8da7-d50fed4dd620 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0567446 Dec 20 05:59:44.549579 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-36b07f8b-6450-4ab3-a824-8e737fc8af0d req-3280b4eb-054d-404d-8926-f44aae5e8bee tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454991 Dec 20 05:59:44.808740 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-96cb1980-8b3c-4efd-a722-db9370df1779 req-c82df235-ec36-4b9e-8a39-50c9e60e6a88 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-589922421&fields=id&tenant_id=627c52664e194163a380283ded298eb5 HTTP/1.1" status: 200 len: 267 time: 0.0477235 Dec 20 05:59:44.869151 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96cb1980-8b3c-4efd-a722-db9370df1779 req-c802bf94-2e63-4c75-8bf2-a4f134b793ac tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:44.871022 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-96cb1980-8b3c-4efd-a722-db9370df1779 req-c802bf94-2e63-4c75-8bf2-a4f134b793ac tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 984 time: 0.0523291 Dec 20 05:59:44.882769 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-96cb1980-8b3c-4efd-a722-db9370df1779 req-533a4d3c-bd26-4506-95ec-c06159149109 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Request body: {'port': {'security_groups': ['4484ae16-a55f-40cc-bf6a-ad8ea50924e2']}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 05:59:44.958705 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-96cb1980-8b3c-4efd-a722-db9370df1779 req-533a4d3c-bd26-4506-95ec-c06159149109 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:45.203914 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-96cb1980-8b3c-4efd-a722-db9370df1779 req-533a4d3c-bd26-4506-95ec-c06159149109 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] For port 18320379-21ed-4b2e-af2c-62b95cf39325, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=18320379-21ed-4b2e-af2c-62b95cf39325,segment=NetworkSegment(6a78353a-8122-4f87-a059-aadb4a3c82d5),segment_id=6a78353a-8122-4f87-a059-aadb4a3c82d5)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:45.239046 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-96cb1980-8b3c-4efd-a722-db9370df1779 req-533a4d3c-bd26-4506-95ec-c06159149109 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:45.244768 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-96cb1980-8b3c-4efd-a722-db9370df1779 req-533a4d3c-bd26-4506-95ec-c06159149109 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:45.281935 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['18320379-21ed-4b2e-af2c-62b95cf39325'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:59:45.342630 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96cb1980-8b3c-4efd-a722-db9370df1779 req-533a4d3c-bd26-4506-95ec-c06159149109 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:45.343324 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-96cb1980-8b3c-4efd-a722-db9370df1779 req-533a4d3c-bd26-4506-95ec-c06159149109 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:45.351446 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48890) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:45.352074 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-96cb1980-8b3c-4efd-a722-db9370df1779 req-533a4d3c-bd26-4506-95ec-c06159149109 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "PUT /v2.0/ports/18320379-21ed-4b2e-af2c-62b95cf39325 HTTP/1.1" status: 200 len: 942 time: 0.4740379 Dec 20 05:59:45.352651 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'tag': '18320379-21ed-4b2e-af2c-62b95cf39325'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:59:45.355634 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e1eef8c0-d77d-4770-ac70-0ce859bbe627" -d '{"events": [{"name": "network-changed", "server_uuid": "d315076f-1aa5-4b60-ade2-0210f6406b1d", "tag": "18320379-21ed-4b2e-af2c-62b95cf39325"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:59:45.371823 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-533a4d3c-bd26-4506-95ec-c06159149109 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event updated for resources: {'Port': ['ID=18320379-21ed-4b2e-af2c-62b95cf39325,revision_number=7']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:45.428739 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:59:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-51ac4ede-0a67-4290-81be-8eee63d74357 x-openstack-request-id: req-51ac4ede-0a67-4290-81be-8eee63d74357 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:59:45.429329 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d315076f-1aa5-4b60-ade2-0210f6406b1d", "tag": "18320379-21ed-4b2e-af2c-62b95cf39325", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:59:45.429752 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-51ac4ede-0a67-4290-81be-8eee63d74357 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:59:45.430310 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'tag': '18320379-21ed-4b2e-af2c-62b95cf39325', 'status': 'completed', 'code': 200} Dec 20 05:59:45.485177 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:45.525195 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['18320379-21ed-4b2e-af2c-62b95cf39325'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:59:45.526457 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:45.603833 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1eef8c0-d77d-4770-ac70-0ce859bbe627 req-d606ed32-c8fe-4b85-8124-8d86fd60a284 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:45.606980 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1eef8c0-d77d-4770-ac70-0ce859bbe627 req-d606ed32-c8fe-4b85-8124-8d86fd60a284 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=627c52664e194163a380283ded298eb5&device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 1098 time: 0.1260140 Dec 20 05:59:45.668878 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:45.672491 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:45.677469 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "DELETE /v2.0/security-groups/5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2 HTTP/1.1" status: 204 len: 168 time: 0.3234313 Dec 20 05:59:45.678333 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 48898) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:45.690890 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e137a6d-e6e2-4cc1-8f1e-ead1b0abffe2,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:45.706323 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:45.706965 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:45.707485 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:45.708069 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:45.708674 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:45.709161 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:45.709668 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:45.710167 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:45.710667 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:45.711166 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:45.711712 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:45.712219 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:45.712713 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9a86cdc-042e-400f-acde-ddb5e5f7ff4a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 05:59:45.713068 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-bdef18c7-9b88-495d-be5a-bee021fc07fb None None] Provisioning complete for port 18320379-21ed-4b2e-af2c-62b95cf39325 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 05:59:45.713544 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-bdef18c7-9b88-495d-be5a-bee021fc07fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:45.791819 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b9c5b5-ebe5-472c-80db-db047c144ffd req-b2e2231a-edbe-407c-920f-fd8ac6356137 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:45.799087 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-29b9c5b5-ebe5-472c-80db-db047c144ffd req-b2e2231a-edbe-407c-920f-fd8ac6356137 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.1082160 Dec 20 05:59:45.830020 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1eef8c0-d77d-4770-ac70-0ce859bbe627 req-1bd26912-1082-4e2f-a21e-423d5c127976 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:45.831498 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1eef8c0-d77d-4770-ac70-0ce859bbe627 req-1bd26912-1082-4e2f-a21e-423d5c127976 service neutron] 10.222.0.54 "GET /v2.0/networks?id=4e35b188-ad5c-4cae-9209-b7e538e3669f HTTP/1.1" status: 200 len: 916 time: 0.2158968 Dec 20 05:59:45.878726 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-29b9c5b5-ebe5-472c-80db-db047c144ffd req-b6a26ac9-bfa5-43e9-ba5c-fa3a4d648572 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0786154 Dec 20 05:59:45.958663 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-408bf1b6-6d98-43e0-9844-da0285091581 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Deleting port fd412670-e531-4fa6-b03b-dea2fe3b31a0 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:59:45.959002 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-408bf1b6-6d98-43e0-9844-da0285091581 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:45.961898 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1eef8c0-d77d-4770-ac70-0ce859bbe627 req-9885ce62-1234-4230-9a0e-e1aa514c916a service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=18320379-21ed-4b2e-af2c-62b95cf39325 HTTP/1.1" status: 200 len: 1000 time: 0.1048627 Dec 20 05:59:46.031824 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1eef8c0-d77d-4770-ac70-0ce859bbe627 req-7462ba1e-e364-49a4-a4c3-e19e36c51974 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:46.033452 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1eef8c0-d77d-4770-ac70-0ce859bbe627 req-7462ba1e-e364-49a4-a4c3-e19e36c51974 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fca5c9c5-06df-4c64-840c-e8558a30dd3c HTTP/1.1" status: 200 len: 854 time: 0.0510790 Dec 20 05:59:46.048549 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-408bf1b6-6d98-43e0-9844-da0285091581 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:46.048781 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-408bf1b6-6d98-43e0-9844-da0285091581 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:46.062097 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-408bf1b6-6d98-43e0-9844-da0285091581 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Calling delete_port for fd412670-e531-4fa6-b03b-dea2fe3b31a0 owned by network:floatingip {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:59:46.093063 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1eef8c0-d77d-4770-ac70-0ce859bbe627 req-45f4ef42-42da-4dc2-bb34-9b69e4a69d3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:46.094736 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1eef8c0-d77d-4770-ac70-0ce859bbe627 req-45f4ef42-42da-4dc2-bb34-9b69e4a69d3b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4e35b188-ad5c-4cae-9209-b7e538e3669f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0534062 Dec 20 05:59:46.217151 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1eef8c0-d77d-4770-ac70-0ce859bbe627 req-85d6645e-6b42-4e6c-af8f-45fb67b73acd service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1098945 Dec 20 05:59:46.266048 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-408bf1b6-6d98-43e0-9844-da0285091581 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:46.304855 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-408bf1b6-6d98-43e0-9844-da0285091581 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event deleted for resources: {'Port': ['ID=fd412670-e531-4fa6-b03b-dea2fe3b31a0,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:46.334838 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1eef8c0-d77d-4770-ac70-0ce859bbe627 req-5b195355-25ac-4ab5-ac36-64dccfe14c81 service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1053991 Dec 20 05:59:46.385256 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-408bf1b6-6d98-43e0-9844-da0285091581 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks [] for floatingip, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:46.385893 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.l3_db [None req-408bf1b6-6d98-43e0-9844-da0285091581 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Floating IP 345f873f-5237-43db-badd-ea1b7efa8c26 disassociated (deleted). External IP: 172.27.3.78, port: 18320379-21ed-4b2e-af2c-62b95cf39325. Dec 20 05:59:46.640331 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-408bf1b6-6d98-43e0-9844-da0285091581 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Router 62843140-b8ec-4625-b180-0cf2bab5498f has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:59:46.760237 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-408bf1b6-6d98-43e0-9844-da0285091581 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:59:46.766122 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-408bf1b6-6d98-43e0-9844-da0285091581 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:46.772428 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-505927d3-62cd-4e83-b04b-a6dd5dc3ace5 None None] Sync routers for ids ['62843140-b8ec-4625-b180-0cf2bab5498f'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:59:46.784408 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-505927d3-62cd-4e83-b04b-a6dd5dc3ace5 None None] Routers {'62843140-b8ec-4625-b180-0cf2bab5498f'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:59:46.785316 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-505927d3-62cd-4e83-b04b-a6dd5dc3ace5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:59:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['62843140-b8ec-4625-b180-0cf2bab5498f'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:46.799475 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-408bf1b6-6d98-43e0-9844-da0285091581 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "DELETE /v2.0/floatingips/345f873f-5237-43db-badd-ea1b7efa8c26 HTTP/1.1" status: 204 len: 168 time: 1.1097651 Dec 20 05:59:46.800129 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'tag': '18320379-21ed-4b2e-af2c-62b95cf39325'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:59:46.803017 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2abba6fd-6502-4876-bdcf-d8f3a14d6289" -d '{"events": [{"name": "network-changed", "server_uuid": "d315076f-1aa5-4b60-ade2-0210f6406b1d", "tag": "18320379-21ed-4b2e-af2c-62b95cf39325"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:59:46.944583 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 05:59:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2e03699-38bf-4349-88c8-ec824c62f151 x-openstack-request-id: req-d2e03699-38bf-4349-88c8-ec824c62f151 {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:59:46.944947 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d315076f-1aa5-4b60-ade2-0210f6406b1d", "tag": "18320379-21ed-4b2e-af2c-62b95cf39325", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:59:46.945774 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-d2e03699-38bf-4349-88c8-ec824c62f151 {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:59:46.946247 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'tag': '18320379-21ed-4b2e-af2c-62b95cf39325', 'status': 'completed', 'code': 200} Dec 20 05:59:46.947457 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-505927d3-62cd-4e83-b04b-a6dd5dc3ace5 None None] Set router 62843140-b8ec-4625-b180-0cf2bab5498f gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:59:47.112616 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abba6fd-6502-4876-bdcf-d8f3a14d6289 req-8d620a23-afc9-4db1-8eca-ce2e78bc8176 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:47.114172 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2abba6fd-6502-4876-bdcf-d8f3a14d6289 req-8d620a23-afc9-4db1-8eca-ce2e78bc8176 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=627c52664e194163a380283ded298eb5&device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 1098 time: 0.1104252 Dec 20 05:59:47.133461 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f68938a-246d-4226-87a9-421feb6c373c req-5c34bc86-80a3-4d26-a219-3b54889767c9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:47.134964 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3f68938a-246d-4226-87a9-421feb6c373c req-5c34bc86-80a3-4d26-a219-3b54889767c9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0919299 Dec 20 05:59:47.250016 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3f68938a-246d-4226-87a9-421feb6c373c req-a92a30f8-9edf-42e6-be89-6dfc25d18646 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1008732 Dec 20 05:59:47.297275 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abba6fd-6502-4876-bdcf-d8f3a14d6289 req-179995ad-e325-4da1-baa3-4ad532da4b81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:47.299083 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2abba6fd-6502-4876-bdcf-d8f3a14d6289 req-179995ad-e325-4da1-baa3-4ad532da4b81 service neutron] 10.222.0.54 "GET /v2.0/networks?id=4e35b188-ad5c-4cae-9209-b7e538e3669f HTTP/1.1" status: 200 len: 916 time: 0.1631835 Dec 20 05:59:47.299664 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-505927d3-62cd-4e83-b04b-a6dd5dc3ace5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69'}], 'enable_snat': True}, 'gw_port_id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:56:36Z', 'revision_number': 4, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port': {'id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:96:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 484, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:34Z', 'updated_at': '2021-12-20T05:56:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '526d693f-a680-4d0e-a26f-98f517a8db50', 'name': '', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'tenant_id': '627c52664e194163a380283ded298eb5', 'mac_address': 'fa:16:3e:cb:78:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_interface', 'standard_attr_id': 485, 'fixed_ips': [{'subnet_id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:36Z', 'updated_at': '2021-12-20T05:56:41Z', 'revision_number': 5, 'project_id': '627c52664e194163a380283ded298eb5', 'subnets': [{'id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:47.336876 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-505927d3-62cd-4e83-b04b-a6dd5dc3ace5 None None] Checking router: 62843140-b8ec-4625-b180-0cf2bab5498f for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:59:47.349404 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2abba6fd-6502-4876-bdcf-d8f3a14d6289 req-7145bb0f-f2bb-4dca-981e-ded7f9b170df service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=18320379-21ed-4b2e-af2c-62b95cf39325 HTTP/1.1" status: 200 len: 217 time: 0.0375116 Dec 20 05:59:47.368139 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-505927d3-62cd-4e83-b04b-a6dd5dc3ace5 None None] Routers {'62843140-b8ec-4625-b180-0cf2bab5498f'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:59:47.369132 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-505927d3-62cd-4e83-b04b-a6dd5dc3ace5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:59:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['62843140-b8ec-4625-b180-0cf2bab5498f'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:47.437413 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abba6fd-6502-4876-bdcf-d8f3a14d6289 req-718cad91-5fc7-48a7-aaf8-47691db3ef78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:47.439219 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2abba6fd-6502-4876-bdcf-d8f3a14d6289 req-718cad91-5fc7-48a7-aaf8-47691db3ef78 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=fca5c9c5-06df-4c64-840c-e8558a30dd3c HTTP/1.1" status: 200 len: 854 time: 0.0717182 Dec 20 05:59:47.492394 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-505927d3-62cd-4e83-b04b-a6dd5dc3ace5 None None] Set router 62843140-b8ec-4625-b180-0cf2bab5498f gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:59:47.537339 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abba6fd-6502-4876-bdcf-d8f3a14d6289 req-be56d775-0e8f-4816-b9ef-8501838ee97d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:47.539409 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2abba6fd-6502-4876-bdcf-d8f3a14d6289 req-be56d775-0e8f-4816-b9ef-8501838ee97d service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=4e35b188-ad5c-4cae-9209-b7e538e3669f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0908518 Dec 20 05:59:47.670786 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2abba6fd-6502-4876-bdcf-d8f3a14d6289 req-e0058f85-a3dc-4cad-b1ad-578c4a2e6c88 service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1186039 Dec 20 05:59:47.812633 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2abba6fd-6502-4876-bdcf-d8f3a14d6289 req-b0fb8563-bfa0-4fb6-a4df-ee0422eda7b2 service neutron] 10.222.0.54 "GET /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1318562 Dec 20 05:59:47.934173 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-505927d3-62cd-4e83-b04b-a6dd5dc3ace5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69'}], 'enable_snat': True}, 'gw_port_id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:56:36Z', 'revision_number': 4, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port': {'id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:96:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 484, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:34Z', 'updated_at': '2021-12-20T05:56:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '526d693f-a680-4d0e-a26f-98f517a8db50', 'name': '', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'tenant_id': '627c52664e194163a380283ded298eb5', 'mac_address': 'fa:16:3e:cb:78:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_interface', 'standard_attr_id': 485, 'fixed_ips': [{'subnet_id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:36Z', 'updated_at': '2021-12-20T05:56:41Z', 'revision_number': 5, 'project_id': '627c52664e194163a380283ded298eb5', 'subnets': [{'id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:47.981253 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-505927d3-62cd-4e83-b04b-a6dd5dc3ace5 None None] The sync data for ids ['62843140-b8ec-4625-b180-0cf2bab5498f'] in dv-cinder-822278-1-iscsi is: [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69'}], 'enable_snat': True}, 'gw_port_id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:56:36Z', 'revision_number': 4, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port': {'id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:96:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 484, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:34Z', 'updated_at': '2021-12-20T05:56:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '526d693f-a680-4d0e-a26f-98f517a8db50', 'name': '', 'network_id': '4e35b188-ad5c-4cae-9209-b7e538e3669f', 'tenant_id': '627c52664e194163a380283ded298eb5', 'mac_address': 'fa:16:3e:cb:78:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_interface', 'standard_attr_id': 485, 'fixed_ips': [{'subnet_id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:36Z', 'updated_at': '2021-12-20T05:56:41Z', 'revision_number': 5, 'project_id': '627c52664e194163a380283ded298eb5', 'subnets': [{'id': 'fca5c9c5-06df-4c64-840c-e8558a30dd3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:59:48.413805 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e350d41-61b6-4d5b-97db-56be2e8cc1a9 None None] New status for floating IP 345f873f-5237-43db-badd-ea1b7efa8c26: DOWN {{(pid=102448) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 05:59:48.427421 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed8ef838-f3e2-4e6a-af57-bddf3936ed26 req-d57f689f-3197-4768-8428-35ed1d031106 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:48.438257 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ed8ef838-f3e2-4e6a-af57-bddf3936ed26 req-d57f689f-3197-4768-8428-35ed1d031106 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0747757 Dec 20 05:59:48.536114 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ed8ef838-f3e2-4e6a-af57-bddf3936ed26 req-734d0208-eb2d-4d7c-b19e-33b1abd561ce tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0946846 Dec 20 05:59:48.585372 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c4ff309-61fd-4005-aba4-5a891321e5a7 req-65352ebe-c56c-4fff-bbad-124b9f482130 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:48.586826 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2c4ff309-61fd-4005-aba4-5a891321e5a7 req-65352ebe-c56c-4fff-bbad-124b9f482130 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 945 time: 0.1249800 Dec 20 05:59:48.646854 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2c4ff309-61fd-4005-aba4-5a891321e5a7 req-cc6ee7e6-6e73-45d4-851a-f55657bf1e70 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0533447 Dec 20 05:59:49.672715 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12769477-4337-432f-80d9-08e726af9522 req-6d21313f-f863-4791-8072-3b379d036b83 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:49.682039 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-12769477-4337-432f-80d9-08e726af9522 req-6d21313f-f863-4791-8072-3b379d036b83 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0655909 Dec 20 05:59:49.741992 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-12769477-4337-432f-80d9-08e726af9522 req-af1c2a92-d017-482e-a321-c2b58ddb7f63 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0588393 Dec 20 05:59:49.797514 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df05a7e-f89c-4584-9743-d5ddcdfd8114 req-291bd1a7-58b9-41dc-bfed-58341ee0f288 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:49.799853 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9df05a7e-f89c-4584-9743-d5ddcdfd8114 req-291bd1a7-58b9-41dc-bfed-58341ee0f288 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 945 time: 0.0567651 Dec 20 05:59:49.857346 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9df05a7e-f89c-4584-9743-d5ddcdfd8114 req-f1d020a2-1356-4df9-bd99-97af94923ee5 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504534 Dec 20 05:59:50.818104 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-1bfbef05-e7b9-4112-b153-e68ebfb3285f tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:50.819607 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-1bfbef05-e7b9-4112-b153-e68ebfb3285f tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.54 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 945 time: 0.0949538 Dec 20 05:59:50.959971 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19656c92-c91a-4b11-8469-73db5ff11f24 req-ea589ca1-17ee-4ca9-b3b1-eb7913673006 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:50.961803 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-19656c92-c91a-4b11-8469-73db5ff11f24 req-ea589ca1-17ee-4ca9-b3b1-eb7913673006 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 945 time: 0.1732252 Dec 20 05:59:50.969163 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b94685c-8e59-4b3f-ae82-b7420b0acf1b req-bed513d5-b482-467d-bbe7-464781e5cf4a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:50.971830 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4b94685c-8e59-4b3f-ae82-b7420b0acf1b req-bed513d5-b482-467d-bbe7-464781e5cf4a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.1215498 Dec 20 05:59:51.068974 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-19656c92-c91a-4b11-8469-73db5ff11f24 req-9f9baf1b-2872-4e69-8e56-702becd60fa5 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0947995 Dec 20 05:59:51.072857 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4b94685c-8e59-4b3f-ae82-b7420b0acf1b req-75b7737a-288b-46e3-812b-9edc26a720c3 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0914822 Dec 20 05:59:51.088963 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Deleting port 99279753-6934-4d6f-88dc-e3785468af1d {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:59:51.090989 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:51.223883 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] For port 99279753-6934-4d6f-88dc-e3785468af1d, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=99279753-6934-4d6f-88dc-e3785468af1d,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:51.224158 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:51.243455 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be749daa-7abf-4fa7-9ece-98b47039425a req-b5aa9cc6-0a80-4e0c-bf41-32004e573595 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:51.250217 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-be749daa-7abf-4fa7-9ece-98b47039425a req-b5aa9cc6-0a80-4e0c-bf41-32004e573595 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 945 time: 0.0897522 Dec 20 05:59:51.622535 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-be749daa-7abf-4fa7-9ece-98b47039425a req-59336b9f-b299-4563-9a0d-7579aaadfad3 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups?id=389c1ab1-5cef-451a-a23b-8602a35f4d94&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3659129 Dec 20 05:59:51.696475 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:51.696861 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:51.697180 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.l3_db [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Floating IP 1fe55298-6d1d-4aae-b449-b53519d7ed2c disassociated. External IP: 172.27.3.17, port: 99279753-6934-4d6f-88dc-e3785468af1d. Dec 20 05:59:51.697525 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Calling delete_port for 99279753-6934-4d6f-88dc-e3785468af1d owned by compute:nova {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:59:51.824493 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:51.854037 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event deleted for resources: {'Port': ['ID=99279753-6934-4d6f-88dc-e3785468af1d,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:51.966388 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Router 3f858ad2-b10f-4f04-9727-f99638a01796 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:59:52.072217 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:59:52.080944 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61244a8-55b0-42df-9bc6-15564b9ff4fd req-782a572e-b699-4d56-87dd-b5c516d589c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:52.082493 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c61244a8-55b0-42df-9bc6-15564b9ff4fd req-782a572e-b699-4d56-87dd-b5c516d589c6 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 1099 time: 0.0433862 Dec 20 05:59:52.088318 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b293da4-d0b1-47ed-8214-107de3433c91 None None] Sync routers for ids ['3f858ad2-b10f-4f04-9727-f99638a01796'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:59:52.098610 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b293da4-d0b1-47ed-8214-107de3433c91 None None] Routers {'3f858ad2-b10f-4f04-9727-f99638a01796'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:59:52.099482 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-6b293da4-d0b1-47ed-8214-107de3433c91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:59:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['3f858ad2-b10f-4f04-9727-f99638a01796'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:52.153930 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] No DVR routers for this DVR port 99279753-6934-4d6f-88dc-e3785468af1d on host hv-cinder-82227 {{(pid=102445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 05:59:52.158835 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:52.162243 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-baea9e4b-a4d0-48b9-9c9c-6da5574473b2 req-c06a0301-c06a-4eb6-860f-0e7d85edf7e2 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.54 "DELETE /v2.0/ports/99279753-6934-4d6f-88dc-e3785468af1d HTTP/1.1" status: 204 len: 173 time: 1.3194537 Dec 20 05:59:52.163899 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0b14fdd5-af46-4268-a3b8-06d9f0a9196b', 'name': 'network-vif-deleted', 'tag': '99279753-6934-4d6f-88dc-e3785468af1d'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:59:52.166299 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c58b5265-45df-4593-b8f6-4b243b203cbb" -d '{"events": [{"server_uuid": "0b14fdd5-af46-4268-a3b8-06d9f0a9196b", "name": "network-vif-deleted", "tag": "99279753-6934-4d6f-88dc-e3785468af1d"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:59:52.211732 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61244a8-55b0-42df-9bc6-15564b9ff4fd req-dba8282b-986b-4cbe-8a3a-809d809e6cd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:52.213301 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c61244a8-55b0-42df-9bc6-15564b9ff4fd req-dba8282b-986b-4cbe-8a3a-809d809e6cd0 service neutron] 10.222.0.54 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 917 time: 0.1196005 Dec 20 05:59:52.231324 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-6b293da4-d0b1-47ed-8214-107de3433c91 None None] Set router 3f858ad2-b10f-4f04-9727-f99638a01796 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:59:52.261303 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-216269ad-75cd-46a2-8e78-c6db815807a7 req-209eb90e-fa8d-4c6e-8029-0701d6a87e1c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:52.262332 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-216269ad-75cd-46a2-8e78-c6db815807a7 req-209eb90e-fa8d-4c6e-8029-0701d6a87e1c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0773666 Dec 20 05:59:52.269846 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8876521-7786-4c56-adee-1dd60745e3b6 req-3bbe2108-58d8-4c0f-bf45-da806a34d293 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:52.271381 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f8876521-7786-4c56-adee-1dd60745e3b6 req-3bbe2108-58d8-4c0f-bf45-da806a34d293 tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 945 time: 0.1082494 Dec 20 05:59:52.324145 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c61244a8-55b0-42df-9bc6-15564b9ff4fd req-660b6ab8-4a39-4590-b887-36679ebf8959 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2 HTTP/1.1" status: 200 len: 1001 time: 0.1020751 Dec 20 05:59:52.356742 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-216269ad-75cd-46a2-8e78-c6db815807a7 req-c7cd25a7-3064-4ad7-ab3e-1882df9554dd tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0843346 Dec 20 05:59:52.382584 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f8876521-7786-4c56-adee-1dd60745e3b6 req-cda409ca-9adc-4101-a81e-4826d09ed20a tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1042666 Dec 20 05:59:52.402565 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61244a8-55b0-42df-9bc6-15564b9ff4fd req-d191cb11-8dfa-4a90-b83d-895aee6c648e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:52.404106 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c61244a8-55b0-42df-9bc6-15564b9ff4fd req-d191cb11-8dfa-4a90-b83d-895aee6c648e service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4b218758-bd28-403f-ac97-d980db9b78c8 HTTP/1.1" status: 200 len: 855 time: 0.0696385 Dec 20 05:59:52.447846 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:59:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9645988f-6001-41a4-86aa-192af0ad3fd2 x-openstack-request-id: req-9645988f-6001-41a4-86aa-192af0ad3fd2 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:59:52.448164 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0b14fdd5-af46-4268-a3b8-06d9f0a9196b", "name": "network-vif-deleted", "tag": "99279753-6934-4d6f-88dc-e3785468af1d", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:59:52.448455 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-9645988f-6001-41a4-86aa-192af0ad3fd2 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:59:52.448898 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0b14fdd5-af46-4268-a3b8-06d9f0a9196b', 'name': 'network-vif-deleted', 'tag': '99279753-6934-4d6f-88dc-e3785468af1d', 'status': 'completed', 'code': 200} Dec 20 05:59:52.465114 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-6b293da4-d0b1-47ed-8214-107de3433c91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:35Z', 'revision_number': 5, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:52.468409 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61244a8-55b0-42df-9bc6-15564b9ff4fd req-38192c4e-0bb2-41df-b0f3-652b1ed9cbe0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:52.469857 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c61244a8-55b0-42df-9bc6-15564b9ff4fd req-38192c4e-0bb2-41df-b0f3-652b1ed9cbe0 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6623d855-6648-40fd-8a49-9c323edbff11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0561004 Dec 20 05:59:52.492802 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b293da4-d0b1-47ed-8214-107de3433c91 None None] Checking router: 3f858ad2-b10f-4f04-9727-f99638a01796 for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:59:52.501223 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b293da4-d0b1-47ed-8214-107de3433c91 None None] Routers {'3f858ad2-b10f-4f04-9727-f99638a01796'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:59:52.501837 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-6b293da4-d0b1-47ed-8214-107de3433c91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:59:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['3f858ad2-b10f-4f04-9727-f99638a01796'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:52.569415 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c61244a8-55b0-42df-9bc6-15564b9ff4fd req-65d92a2f-ab2d-478a-be80-a363f2fe63e9 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867350 Dec 20 05:59:52.608829 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-6b293da4-d0b1-47ed-8214-107de3433c91 None None] Set router 3f858ad2-b10f-4f04-9727-f99638a01796 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:59:52.659630 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c61244a8-55b0-42df-9bc6-15564b9ff4fd req-62857bd4-f31a-4f1d-877f-6e23b0c0cb1e service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821347 Dec 20 05:59:52.737017 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c9a7776e-bd31-4ac1-8bd4-a9b1c4d4c025 req-48ccef25-0c11-42bf-abca-a06e00cd9050 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/ports?device_id=0b14fdd5-af46-4268-a3b8-06d9f0a9196b HTTP/1.1" status: 200 len: 210 time: 0.0289423 Dec 20 05:59:52.813455 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-6b293da4-d0b1-47ed-8214-107de3433c91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:35Z', 'revision_number': 5, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:52.840700 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b293da4-d0b1-47ed-8214-107de3433c91 None None] The sync data for ids ['3f858ad2-b10f-4f04-9727-f99638a01796'] in dv-cinder-822278-1-iscsi is: [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:53:29Z', 'revision_number': 4, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '313310c9-f961-4d30-aedb-324e4e6e1a26', 'name': '', 'network_id': '6924a88e-10c1-4073-a41c-88aad14ebd0f', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'mac_address': 'fa:16:3e:e0:3b:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_interface', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:28Z', 'updated_at': '2021-12-20T05:53:35Z', 'revision_number': 5, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'subnets': [{'id': 'ffb588f9-2ffb-4921-8a76-be5179c2fbed', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:59:53.055232 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ae0784f-b334-4784-8a5f-ee3127a1ce9c None None] New status for floating IP 1fe55298-6d1d-4aae-b449-b53519d7ed2c: DOWN {{(pid=102448) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 05:59:53.357064 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c0f2a5-c91d-42e8-b47e-a46f97fd1516 req-a9d2da80-e971-4936-94cc-501b3381d7ca tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:53.358518 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c5c0f2a5-c91d-42e8-b47e-a46f97fd1516 req-a9d2da80-e971-4936-94cc-501b3381d7ca tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.54 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 945 time: 0.0516739 Dec 20 05:59:53.453735 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-c5c0f2a5-c91d-42e8-b47e-a46f97fd1516 req-5f190a0d-981b-4164-aeab-88004d381e9f tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Deleting port 18320379-21ed-4b2e-af2c-62b95cf39325 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:59:53.454085 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-c5c0f2a5-c91d-42e8-b47e-a46f97fd1516 req-5f190a0d-981b-4164-aeab-88004d381e9f tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:53.491311 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbdaf42b-8b27-42f6-b01b-ad0346cc8a0e req-8b836eac-4999-4964-a42f-8e64882cd80b tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:53.492828 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cbdaf42b-8b27-42f6-b01b-ad0346cc8a0e req-8b836eac-4999-4964-a42f-8e64882cd80b tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/ports?device_id=d315076f-1aa5-4b60-ade2-0210f6406b1d HTTP/1.1" status: 200 len: 945 time: 0.0564194 Dec 20 05:59:53.548215 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-c5c0f2a5-c91d-42e8-b47e-a46f97fd1516 req-5f190a0d-981b-4164-aeab-88004d381e9f tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] For port 18320379-21ed-4b2e-af2c-62b95cf39325, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=18320379-21ed-4b2e-af2c-62b95cf39325,segment=NetworkSegment(6a78353a-8122-4f87-a059-aadb4a3c82d5),segment_id=6a78353a-8122-4f87-a059-aadb4a3c82d5)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:53.548575 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-c5c0f2a5-c91d-42e8-b47e-a46f97fd1516 req-5f190a0d-981b-4164-aeab-88004d381e9f tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:53.560194 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-c5c0f2a5-c91d-42e8-b47e-a46f97fd1516 req-5f190a0d-981b-4164-aeab-88004d381e9f tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Calling delete_port for 18320379-21ed-4b2e-af2c-62b95cf39325 owned by compute:nova {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:59:53.574395 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54a9e5de-2f62-4196-ab18-ee3d3e046773 req-da0ff772-a7ac-418c-90f5-74a85c421f0a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:53.575889 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-54a9e5de-2f62-4196-ab18-ee3d3e046773 req-da0ff772-a7ac-418c-90f5-74a85c421f0a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 946 time: 0.0821879 Dec 20 05:59:53.579753 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cbdaf42b-8b27-42f6-b01b-ad0346cc8a0e req-d4927f25-8bb4-4adc-b963-1a273ea29bdb tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.46 "GET /v2.0/security-groups?id=4484ae16-a55f-40cc-bf6a-ad8ea50924e2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0781913 Dec 20 05:59:53.624290 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-54a9e5de-2f62-4196-ab18-ee3d3e046773 req-c41edafe-529b-47b3-80c1-abf78626ed61 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417414 Dec 20 05:59:53.686563 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-c5c0f2a5-c91d-42e8-b47e-a46f97fd1516 req-5f190a0d-981b-4164-aeab-88004d381e9f tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:53.719013 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f190a0d-981b-4164-aeab-88004d381e9f tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Pushing event deleted for resources: {'Port': ['ID=18320379-21ed-4b2e-af2c-62b95cf39325,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:53.724267 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['18320379-21ed-4b2e-af2c-62b95cf39325'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 05:59:53.762323 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-c5c0f2a5-c91d-42e8-b47e-a46f97fd1516 req-5f190a0d-981b-4164-aeab-88004d381e9f tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] No DVR routers for this DVR port 18320379-21ed-4b2e-af2c-62b95cf39325 on host hv-cinder-82227 {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 05:59:53.764768 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-c5c0f2a5-c91d-42e8-b47e-a46f97fd1516 req-5f190a0d-981b-4164-aeab-88004d381e9f tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:53.768193 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c5c0f2a5-c91d-42e8-b47e-a46f97fd1516 req-5f190a0d-981b-4164-aeab-88004d381e9f tempest-TestMinimumBasicScenario-697545263 tempest-TestMinimumBasicScenario-697545263-project] 10.222.0.54 "DELETE /v2.0/ports/18320379-21ed-4b2e-af2c-62b95cf39325 HTTP/1.1" status: 204 len: 173 time: 0.4023244 Dec 20 05:59:53.768626 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'name': 'network-vif-deleted', 'tag': '18320379-21ed-4b2e-af2c-62b95cf39325'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:59:53.770822 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c4039eb-5226-4648-ba58-74e844dcaf35" -d '{"events": [{"server_uuid": "d315076f-1aa5-4b60-ade2-0210f6406b1d", "name": "network-vif-deleted", "tag": "18320379-21ed-4b2e-af2c-62b95cf39325"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:59:53.806921 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 05:59:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aed5eced-1600-4338-850a-cb7331fa0b0d x-openstack-request-id: req-aed5eced-1600-4338-850a-cb7331fa0b0d {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:59:53.807292 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d315076f-1aa5-4b60-ade2-0210f6406b1d", "name": "network-vif-deleted", "tag": "18320379-21ed-4b2e-af2c-62b95cf39325", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:59:53.807898 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-aed5eced-1600-4338-850a-cb7331fa0b0d {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:59:53.808349 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd315076f-1aa5-4b60-ade2-0210f6406b1d', 'name': 'network-vif-deleted', 'tag': '18320379-21ed-4b2e-af2c-62b95cf39325', 'status': 'completed', 'code': 200} Dec 20 05:59:53.823286 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49000) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:53.877088 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0b752bc1-2764-4286-8ac1-b43b5c47f0eb tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:53.902894 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0b752bc1-2764-4286-8ac1-b43b5c47f0eb tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:53.952820 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0b752bc1-2764-4286-8ac1-b43b5c47f0eb tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:53.955863 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-0b752bc1-2764-4286-8ac1-b43b5c47f0eb tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:53.957046 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-0b752bc1-2764-4286-8ac1-b43b5c47f0eb tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "DELETE /v2.0/security-groups/389c1ab1-5cef-451a-a23b-8602a35f4d94 HTTP/1.1" status: 204 len: 168 time: 0.1327162 Dec 20 05:59:53.960054 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49002) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:53.966713 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b752bc1-2764-4286-8ac1-b43b5c47f0eb tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=389c1ab1-5cef-451a-a23b-8602a35f4d94,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:53.972836 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.api.v2.resource [None req-e8755608-9762-4769-9e25-8edf81a30456 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] show failed (client error): The resource could not be found. Dec 20 05:59:53.973880 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-e8755608-9762-4769-9e25-8edf81a30456 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "GET /v2.0/security-groups/389c1ab1-5cef-451a-a23b-8602a35f4d94 HTTP/1.1" status: 404 len: 347 time: 0.0126193 Dec 20 05:59:53.976912 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49004) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:54.101182 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-5bacad0c-dd6f-4163-a69f-082ed53c36a9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Deleting port bff044dc-232a-4d68-adcc-42ca79ee3945 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:59:54.101513 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5bacad0c-dd6f-4163-a69f-082ed53c36a9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:54.181475 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5bacad0c-dd6f-4163-a69f-082ed53c36a9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:54.181801 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5bacad0c-dd6f-4163-a69f-082ed53c36a9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:54.193972 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-5bacad0c-dd6f-4163-a69f-082ed53c36a9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Calling delete_port for bff044dc-232a-4d68-adcc-42ca79ee3945 owned by network:floatingip {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:59:54.325065 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5bacad0c-dd6f-4163-a69f-082ed53c36a9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:54.350355 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bacad0c-dd6f-4163-a69f-082ed53c36a9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Pushing event deleted for resources: {'Port': ['ID=bff044dc-232a-4d68-adcc-42ca79ee3945,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:54.411079 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5bacad0c-dd6f-4163-a69f-082ed53c36a9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks [] for floatingip, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:54.413754 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5bacad0c-dd6f-4163-a69f-082ed53c36a9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:54.414908 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-5bacad0c-dd6f-4163-a69f-082ed53c36a9 tempest-AttachVolumeTestJSON-1869269077 tempest-AttachVolumeTestJSON-1869269077-project] 10.222.0.46 "DELETE /v2.0/floatingips/1fe55298-6d1d-4aae-b449-b53519d7ed2c HTTP/1.1" status: 204 len: 168 time: 0.4370461 Dec 20 05:59:54.564320 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 18320379-21ed-4b2e-af2c-62b95cf39325 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:59:54.586953 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: 18320379-21ed-4b2e-af2c-62b95cf39325 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:59:54.587291 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 18320379-21ed-4b2e-af2c-62b95cf39325 not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:59:54.587717 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 9e825da9-eb60-4572-8a89-92caa8cddaa2 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:59:54.662323 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:54.691440 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9e825da9-eb60-4572-8a89-92caa8cddaa2'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 05:59:54.694635 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db713e82-23d8-44fb-a5de-b55cfd401ca0" -d '{"events": [{"server_uuid": "8e0ee236-8474-4f2a-b875-752d3dec628f", "name": "network-vif-unplugged", "status": "completed", "tag": "9e825da9-eb60-4572-8a89-92caa8cddaa2"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 05:59:54.712003 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 9e825da9-eb60-4572-8a89-92caa8cddaa2, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:54.719562 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:54.720465 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 99279753-6934-4d6f-88dc-e3785468af1d no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:59:54.742832 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: 99279753-6934-4d6f-88dc-e3785468af1d {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:59:54.743461 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 99279753-6934-4d6f-88dc-e3785468af1d not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:59:54.747247 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Mon, 20 Dec 2021 05:59:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-40004a6b-0942-475e-a640-92802664437b x-openstack-request-id: req-40004a6b-0942-475e-a640-92802664437b {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 05:59:54.747577 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8e0ee236-8474-4f2a-b875-752d3dec628f", "name": "network-vif-unplugged", "status": "completed", "tag": "9e825da9-eb60-4572-8a89-92caa8cddaa2", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 05:59:54.747838 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-40004a6b-0942-475e-a640-92802664437b {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 05:59:54.748225 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'code': 200} Dec 20 05:59:54.771211 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d29a9c83-db66-45ba-b530-9dd74284e176 req-d4dde975-5a41-435e-a7dc-66eebca27dff tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:54.772807 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d29a9c83-db66-45ba-b530-9dd74284e176 req-d4dde975-5a41-435e-a7dc-66eebca27dff tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0714581 Dec 20 05:59:54.803088 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=9e825da9-eb60-4572-8a89-92caa8cddaa2,revision_number=8']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:54.831183 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d29a9c83-db66-45ba-b530-9dd74284e176 req-6c4329eb-ba6c-45d4-b08e-0b5fea4fa9ba tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0500541 Dec 20 05:59:55.175022 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49054) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:55.512723 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-48501d7d-50b5-4de1-a844-8d0ebee983c1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1697024'] for router_interface, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:55.755124 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-48501d7d-50b5-4de1-a844-8d0ebee983c1 admin admin] Deleting port 526d693f-a680-4d0e-a26f-98f517a8db50 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:59:55.755469 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-48501d7d-50b5-4de1-a844-8d0ebee983c1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:55.832120 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-48501d7d-50b5-4de1-a844-8d0ebee983c1 admin admin] For port 526d693f-a680-4d0e-a26f-98f517a8db50, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=526d693f-a680-4d0e-a26f-98f517a8db50,segment=NetworkSegment(6a78353a-8122-4f87-a059-aadb4a3c82d5),segment_id=6a78353a-8122-4f87-a059-aadb4a3c82d5)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:55.832400 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-48501d7d-50b5-4de1-a844-8d0ebee983c1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:55.849399 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-48501d7d-50b5-4de1-a844-8d0ebee983c1 admin admin] Calling delete_port for 526d693f-a680-4d0e-a26f-98f517a8db50 owned by network:router_interface {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:59:55.983550 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b4168b7-2453-4c53-a892-bd4a77f202ab req-09d9d1c7-3194-4f40-ab97-aac61c26ab1f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:55.986213 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9b4168b7-2453-4c53-a892-bd4a77f202ab req-09d9d1c7-3194-4f40-ab97-aac61c26ab1f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0723228 Dec 20 05:59:56.049910 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9b4168b7-2453-4c53-a892-bd4a77f202ab req-f2f55316-9d88-4751-abd4-61567ffbcfa6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468624 Dec 20 05:59:56.069327 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-48501d7d-50b5-4de1-a844-8d0ebee983c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:56.099362 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48501d7d-50b5-4de1-a844-8d0ebee983c1 admin admin] Pushing event deleted for resources: {'Port': ['ID=526d693f-a680-4d0e-a26f-98f517a8db50,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:56.270015 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-48501d7d-50b5-4de1-a844-8d0ebee983c1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1617481', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1697260'] for router_interface, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:56.500567 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-48501d7d-50b5-4de1-a844-8d0ebee983c1 admin admin] Router 62843140-b8ec-4625-b180-0cf2bab5498f has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 05:59:56.714834 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85e5ca2e-d41b-4edd-a26b-b5f4f824f56e req-974f1791-fe48-445b-aa3b-15ca821bfb80 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:56.716712 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-85e5ca2e-d41b-4edd-a26b-b5f4f824f56e req-974f1791-fe48-445b-aa3b-15ca821bfb80 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0731738 Dec 20 05:59:56.777466 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-85e5ca2e-d41b-4edd-a26b-b5f4f824f56e req-5fbaf0f1-566e-46b8-a69f-3c7942b451c4 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0542569 Dec 20 05:59:56.902784 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-48501d7d-50b5-4de1-a844-8d0ebee983c1 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 05:59:56.911339 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49108) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:56.911562 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-48501d7d-50b5-4de1-a844-8d0ebee983c1 admin admin] 10.222.0.46 "PUT /v2.0/routers/62843140-b8ec-4625-b180-0cf2bab5498f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7346921 Dec 20 05:59:56.912394 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfdd54fd-2c67-48d4-a9d6-b63aa4c2bc62 None None] Sync routers for ids ['62843140-b8ec-4625-b180-0cf2bab5498f'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 05:59:56.924271 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfdd54fd-2c67-48d4-a9d6-b63aa4c2bc62 None None] Routers {'62843140-b8ec-4625-b180-0cf2bab5498f'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:59:56.924942 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-bfdd54fd-2c67-48d4-a9d6-b63aa4c2bc62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:59:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['62843140-b8ec-4625-b180-0cf2bab5498f'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:56.987161 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49114) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:57.024744 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] Publish callbacks [] for router, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:57.034503 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-bfdd54fd-2c67-48d4-a9d6-b63aa4c2bc62 None None] Set router 62843140-b8ec-4625-b180-0cf2bab5498f gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:59:57.075242 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-ed2295f5-d3ad-4953-9dae-4145e47f3fdf service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0867496 Dec 20 05:59:57.085663 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-dfedc61b-fe03-45a6-8814-8a790ead6672 service neutron] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102446) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 05:59:57.086619 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-dfedc61b-fe03-45a6-8814-8a790ead6672 service neutron] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0057418 Dec 20 05:59:57.133956 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:57.196391 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] Deleting port e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:59:57.196923 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:57.244813 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-bfdd54fd-2c67-48d4-a9d6-b63aa4c2bc62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69'}], 'enable_snat': True}, 'gw_port_id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:59:55Z', 'revision_number': 5, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port': {'id': 'e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:96:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 484, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:34Z', 'updated_at': '2021-12-20T05:56:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:57.275177 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfdd54fd-2c67-48d4-a9d6-b63aa4c2bc62 None None] Checking router: 62843140-b8ec-4625-b180-0cf2bab5498f for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 05:59:57.279667 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] For port e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:57.280063 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:57.286150 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfdd54fd-2c67-48d4-a9d6-b63aa4c2bc62 None None] Routers {'62843140-b8ec-4625-b180-0cf2bab5498f'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 05:59:57.286913 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-bfdd54fd-2c67-48d4-a9d6-b63aa4c2bc62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:59:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['62843140-b8ec-4625-b180-0cf2bab5498f'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:57.294448 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] Calling delete_port for e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc owned by network:router_gateway {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:59:57.372448 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-bfdd54fd-2c67-48d4-a9d6-b63aa4c2bc62 None None] Set router 62843140-b8ec-4625-b180-0cf2bab5498f gateway port host: None {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 05:59:57.429207 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-bfdd54fd-2c67-48d4-a9d6-b63aa4c2bc62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:59:57Z', 'revision_number': 6, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port_host': None}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:57.456568 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfdd54fd-2c67-48d4-a9d6-b63aa4c2bc62 None None] The sync data for ids ['62843140-b8ec-4625-b180-0cf2bab5498f'] in dv-cinder-822278-1-iscsi is: [{'id': '62843140-b8ec-4625-b180-0cf2bab5498f', 'name': 'tempest-TestMinimumBasicScenario-1345420979-router', 'tenant_id': '627c52664e194163a380283ded298eb5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:33Z', 'updated_at': '2021-12-20T05:59:57Z', 'revision_number': 6, 'project_id': '627c52664e194163a380283ded298eb5', 'gw_port_host': None}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 05:59:57.521031 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:57.547198 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] Pushing event deleted for resources: {'Port': ['ID=e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:57.609009 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1703502'] for router_gateway, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:57.715210 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1698526', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25973'] for router, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:57.717333 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:57.779277 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1698533'] for router, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:57.779781 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 62843140-b8ec-4625-b180-0cf2bab5498f {{(pid=102445) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 20 05:59:57.784527 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] Publish callbacks [] for router, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:57.785666 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-3d56f9d3-c22a-42d4-b305-1c71cec2d90e admin admin] 10.222.0.46 "DELETE /v2.0/routers/62843140-b8ec-4625-b180-0cf2bab5498f HTTP/1.1" status: 204 len: 168 time: 0.8733008 Dec 20 05:59:57.788204 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49124) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:57.832142 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_v2 [None req-533bead1-61a4-42a3-95d7-dbb22b1ac8ee admin admin] Deleting subnet fca5c9c5-06df-4c64-840c-e8558a30dd3c {{(pid=102445) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 05:59:57.835482 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-533bead1-61a4-42a3-95d7-dbb22b1ac8ee admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:57.899283 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-533bead1-61a4-42a3-95d7-dbb22b1ac8ee admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3457727'] for subnet, precommit_delete_associations {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:57.939068 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138b316d-aa0b-421d-a1ad-49863e348fe1 req-d4e23995-b0d9-4dcc-b6c3-918e47c5e99c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:57.940563 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-138b316d-aa0b-421d-a1ad-49863e348fe1 req-d4e23995-b0d9-4dcc-b6c3-918e47c5e99c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0825646 Dec 20 05:59:57.991466 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49134) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:58.050730 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-533bead1-61a4-42a3-95d7-dbb22b1ac8ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.056152 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-138b316d-aa0b-421d-a1ad-49863e348fe1 req-8d6c07f2-5714-41ad-adcc-b3fd01e7d7bc tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1097212 Dec 20 05:59:58.106241 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-533bead1-61a4-42a3-95d7-dbb22b1ac8ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3465107', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3597782'] for subnet, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.131592 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-533bead1-61a4-42a3-95d7-dbb22b1ac8ee admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fca5c9c5-06df-4c64-840c-e8558a30dd3c,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:58.136594 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-533bead1-61a4-42a3-95d7-dbb22b1ac8ee admin admin] Publish callbacks [] for subnet, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.142634 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-694f6aab-6eb0-49d7-81c7-b6dddbd03dcf None None] Network 4e35b188-ad5c-4cae-9209-b7e538e3669f requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 05:59:58.144122 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-533bead1-61a4-42a3-95d7-dbb22b1ac8ee admin admin] 10.222.0.46 "DELETE /v2.0/subnets/fca5c9c5-06df-4c64-840c-e8558a30dd3c HTTP/1.1" status: 204 len: 168 time: 0.3549440 Dec 20 05:59:58.148176 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49138) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:58.237373 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.343640 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Deleting port f4176d81-24d2-4765-a3a7-586fd16e8f13 {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:59:58.344025 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.401652 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d18f6a1b-6d31-457e-b5c1-487ebb377ca9 None None] DHCP port deletion for 4e35b188-ad5c-4cae-9209-b7e538e3669f request from dv-cinder-822278-1-iscsi {{(pid=102447) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 20 05:59:58.413112 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:59:58.442780 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] For port f4176d81-24d2-4765-a3a7-586fd16e8f13, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=f4176d81-24d2-4765-a3a7-586fd16e8f13,segment=NetworkSegment(6a78353a-8122-4f87-a059-aadb4a3c82d5),segment_id=6a78353a-8122-4f87-a059-aadb4a3c82d5)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:58.443646 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.459777 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Calling delete_port for f4176d81-24d2-4765-a3a7-586fd16e8f13 owned by network:dhcp {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:59:58.471165 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:59:58.471429 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device e3dddf2a-ef3b-45b9-ba1e-7bc08814dfdc not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:59:58.472099 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 526d693f-a680-4d0e-a26f-98f517a8db50 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:59:58.500955 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 526d693f-a680-4d0e-a26f-98f517a8db50 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 05:59:58.501298 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 526d693f-a680-4d0e-a26f-98f517a8db50 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 05:59:58.524820 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 9e825da9-eb60-4572-8a89-92caa8cddaa2 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 05:59:58.530228 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-d18f6a1b-6d31-457e-b5c1-487ebb377ca9 None None] Deleting port f4176d81-24d2-4765-a3a7-586fd16e8f13 {{(pid=102447) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:59:58.530845 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-d18f6a1b-6d31-457e-b5c1-487ebb377ca9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.554503 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.568040 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3d718292-338f-4c46-a85d-493842823ff7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1697024'] for router_interface, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.594462 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] No DVR routers for this DVR port f4176d81-24d2-4765-a3a7-586fd16e8f13 on host dv-cinder-822278-1-iscsi {{(pid=102445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 05:59:58.599109 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Pushing event deleted for resources: {'Port': ['ID=f4176d81-24d2-4765-a3a7-586fd16e8f13,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:58.688088 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.713981 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4e35b188-ad5c-4cae-9209-b7e538e3669f']}} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:58.726421 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6a78353a-8122-4f87-a059-aadb4a3c82d5') {'for_net_delete': True} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:58.726765 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6a78353a-8122-4f87-a059-aadb4a3c82d5') {} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 05:59:58.738094 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3457718'] for segment, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.751376 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.758475 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Releasing vlan 436 on physical network physnet1 to pool {{(pid=102445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 05:59:58.758908 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3465205'] for segment, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: Traceback (most recent call last): Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: timer() Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: cb(*args, **kw) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: return func(*args, **kwargs) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: self._notify() Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: self.callback(batched_events) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: event.method(event) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 05:59:58.760754 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: return f(self, *a, **k) Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._get(url).json() Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: return self.request(url, 'GET', **kwargs) Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 05:59:58.763911 dv-cinder-822278-1-iscsi neutron-server[102445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 05:59:58.784545 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-d18f6a1b-6d31-457e-b5c1-487ebb377ca9 None None] For port f4176d81-24d2-4765-a3a7-586fd16e8f13, host dv-cinder-822278-1-iscsi, got binding levels [] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:58.784951 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-d18f6a1b-6d31-457e-b5c1-487ebb377ca9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.799603 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-d18f6a1b-6d31-457e-b5c1-487ebb377ca9 None None] Calling delete_port for f4176d81-24d2-4765-a3a7-586fd16e8f13 owned by network:dhcp {{(pid=102447) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:59:58.806971 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.ipam_backend_mixin [None req-d18f6a1b-6d31-457e-b5c1-487ebb377ca9 None None] Port f4176d81-24d2-4765-a3a7-586fd16e8f13 was not found and therefore no delete operation was performed {{(pid=102447) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 20 05:59:58.820319 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.825738 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.829317 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] 10.222.0.46 "DELETE /v2.0/networks/4e35b188-ad5c-4cae-9209-b7e538e3669f HTTP/1.1" status: 204 len: 168 time: 0.6802835 Dec 20 05:59:58.829663 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-d18f6a1b-6d31-457e-b5c1-487ebb377ca9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340'] for port, after_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:58.842055 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49140) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 05:59:58.846481 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dd598c4-08cf-4921-89ca-addc6741bd09 admin admin] Pushing event deleted for resources: {'Network': ['ID=4e35b188-ad5c-4cae-9209-b7e538e3669f,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:58.864503 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-d18f6a1b-6d31-457e-b5c1-487ebb377ca9 None None] Network 4e35b188-ad5c-4cae-9209-b7e538e3669f is not hosted by any dhcp agent {{(pid=102447) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 20 05:59:58.864971 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d18f6a1b-6d31-457e-b5c1-487ebb377ca9 None None] No DVR routers for this DVR port f4176d81-24d2-4765-a3a7-586fd16e8f13 on host dv-cinder-822278-1-iscsi {{(pid=102447) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 05:59:58.869575 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d18f6a1b-6d31-457e-b5c1-487ebb377ca9 None None] Pushing event deleted for resources: {'Port': ['ID=f4176d81-24d2-4765-a3a7-586fd16e8f13,revision_number=None']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:58.905979 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-3d718292-338f-4c46-a85d-493842823ff7 admin admin] Deleting port 313310c9-f961-4d30-aedb-324e4e6e1a26 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:59:58.906252 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3d718292-338f-4c46-a85d-493842823ff7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:59.040207 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-3d718292-338f-4c46-a85d-493842823ff7 admin admin] For port 313310c9-f961-4d30-aedb-324e4e6e1a26, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=313310c9-f961-4d30-aedb-324e4e6e1a26,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:59.040877 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3d718292-338f-4c46-a85d-493842823ff7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:59.055045 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-8c01750c-78fd-4d99-953a-adfb9f9feb8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:59.056569 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-8c01750c-78fd-4d99-953a-adfb9f9feb8b service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f&tenant_id=60c21858b1c7408daa963605a7c691c0 HTTP/1.1" status: 200 len: 1097 time: 0.1004705 Dec 20 05:59:59.060144 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-3d718292-338f-4c46-a85d-493842823ff7 admin admin] Calling delete_port for 313310c9-f961-4d30-aedb-324e4e6e1a26 owned by network:router_interface {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:59:59.159057 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-e19e8950-6e33-4667-9729-3259c6d1eb8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:59.161462 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-e19e8950-6e33-4667-9729-3259c6d1eb8f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 1097 time: 0.0607617 Dec 20 05:59:59.211640 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-671a2c36-6fd7-4bb8-98b3-c4b4a03b1621 req-8e69b695-4169-49e0-a3fb-54cd84e5d029 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:59.213097 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-671a2c36-6fd7-4bb8-98b3-c4b4a03b1621 req-8e69b695-4169-49e0-a3fb-54cd84e5d029 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0804303 Dec 20 05:59:59.306440 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-bb4bd686-edd9-4dc9-b64d-343b60db8566 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:59.307951 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-bb4bd686-edd9-4dc9-b64d-343b60db8566 service neutron] 10.222.0.54 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 917 time: 0.1138225 Dec 20 05:59:59.398546 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3d718292-338f-4c46-a85d-493842823ff7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:59.403235 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-f3d07655-e438-481f-8b97-fb17eba47cd3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2 HTTP/1.1" status: 200 len: 999 time: 0.0771823 Dec 20 05:59:59.439500 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d718292-338f-4c46-a85d-493842823ff7 admin admin] Pushing event deleted for resources: {'Port': ['ID=313310c9-f961-4d30-aedb-324e4e6e1a26,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 05:59:59.516415 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-6ebab503-876e-4d0a-9cf6-538e65552062 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:59.517897 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-6ebab503-876e-4d0a-9cf6-538e65552062 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4b218758-bd28-403f-ac97-d980db9b78c8 HTTP/1.1" status: 200 len: 855 time: 0.0873213 Dec 20 05:59:59.541032 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-671a2c36-6fd7-4bb8-98b3-c4b4a03b1621 req-9a997f4d-f1c6-40be-a82a-91da97e670c1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3195055 Dec 20 05:59:59.568379 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-57e870fa-2ed9-4ddd-b2b9-831c991f45b7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1697024'] for router_interface, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:59.616328 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-d119e819-5a33-4489-bd5d-002f1aa717d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 05:59:59.617848 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-d119e819-5a33-4489-bd5d-002f1aa717d3 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6623d855-6648-40fd-8a49-9c323edbff11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0915015 Dec 20 05:59:59.719737 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3d718292-338f-4c46-a85d-493842823ff7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1617481', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1697260'] for router_interface, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:59.785651 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-7b1cd7c1-671b-47d4-95a1-adf2c563495c service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1405845 Dec 20 05:59:59.873587 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-57e870fa-2ed9-4ddd-b2b9-831c991f45b7 admin admin] Deleting port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 05:59:59.873924 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-57e870fa-2ed9-4ddd-b2b9-831c991f45b7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:59.953323 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [None req-57e870fa-2ed9-4ddd-b2b9-831c991f45b7 admin admin] For port 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=0fdb5ab3-ae47-4202-a1e2-fe074e8b5730,segment=NetworkSegment(1ae7591b-9735-4985-905b-489b2e4c5d48),segment_id=1ae7591b-9735-4985-905b-489b2e4c5d48)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 05:59:59.953736 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-57e870fa-2ed9-4ddd-b2b9-831c991f45b7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 05:59:59.967766 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-57e870fa-2ed9-4ddd-b2b9-831c991f45b7 admin admin] Calling delete_port for 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 owned by network:router_interface {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 05:59:59.970634 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-79464771-6622-4f42-bb75-14d7dd8a5a93 req-6ece08c6-e723-449a-b2d0-4a50bd632833 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1770172 Dec 20 06:00:00.041515 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3d718292-338f-4c46-a85d-493842823ff7 admin admin] Router 3f858ad2-b10f-4f04-9727-f99638a01796 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:00:00.069905 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device f4176d81-24d2-4765-a3a7-586fd16e8f13 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:00:00.091967 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: f4176d81-24d2-4765-a3a7-586fd16e8f13 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:00:00.092946 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device f4176d81-24d2-4765-a3a7-586fd16e8f13 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:00:00.152906 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3d718292-338f-4c46-a85d-493842823ff7 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:00:00.158955 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-3d718292-338f-4c46-a85d-493842823ff7 admin admin] 10.222.0.46 "PUT /v2.0/routers/3f858ad2-b10f-4f04-9727-f99638a01796/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1658671 Dec 20 06:00:00.161992 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49150) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:00.163717 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe841f9c-34e4-42d4-8ef5-af704b968bd8 None None] Sync routers for ids ['3f858ad2-b10f-4f04-9727-f99638a01796'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:00:00.173555 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe841f9c-34e4-42d4-8ef5-af704b968bd8 None None] Routers {'3f858ad2-b10f-4f04-9727-f99638a01796'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:00:00.174169 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-fe841f9c-34e4-42d4-8ef5-af704b968bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:59:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['3f858ad2-b10f-4f04-9727-f99638a01796'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:00:00.209480 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-57e870fa-2ed9-4ddd-b2b9-831c991f45b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:00.231869 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57e870fa-2ed9-4ddd-b2b9-831c991f45b7 admin admin] Pushing event deleted for resources: {'Port': ['ID=0fdb5ab3-ae47-4202-a1e2-fe074e8b5730,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:00.317743 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] Publish callbacks [] for router, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:00.323018 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-fe841f9c-34e4-42d4-8ef5-af704b968bd8 None None] Set router 3f858ad2-b10f-4f04-9727-f99638a01796 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:00:00.462881 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:00.464653 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-57e870fa-2ed9-4ddd-b2b9-831c991f45b7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1617481', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1697260'] for router_interface, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:00.533412 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] Deleting port 7b5cd9b9-b9f4-4ee3-a49d-93c291685413 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:00:00.533772 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:00.561123 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-fe841f9c-34e4-42d4-8ef5-af704b968bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T05:59:59Z', 'revision_number': 5, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port': {'id': '7b5cd9b9-b9f4-4ee3-a49d-93c291685413', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:0d:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'device_owner': 'network:router_gateway', 'standard_attr_id': 49, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:53:25Z', 'updated_at': '2021-12-20T05:53:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:00:00.692315 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] For port 7b5cd9b9-b9f4-4ee3-a49d-93c291685413, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=7b5cd9b9-b9f4-4ee3-a49d-93c291685413,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:00:00.692704 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:00.714203 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe841f9c-34e4-42d4-8ef5-af704b968bd8 None None] Checking router: 3f858ad2-b10f-4f04-9727-f99638a01796 for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:00:00.724473 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] Calling delete_port for 7b5cd9b9-b9f4-4ee3-a49d-93c291685413 owned by network:router_gateway {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:00:00.726209 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe841f9c-34e4-42d4-8ef5-af704b968bd8 None None] Routers {'3f858ad2-b10f-4f04-9727-f99638a01796'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:00:00.727162 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-fe841f9c-34e4-42d4-8ef5-af704b968bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:59:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['3f858ad2-b10f-4f04-9727-f99638a01796'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:00:00.796054 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-179d4c13-d5a2-4d97-9013-99a2f090a5ac req-849ee5e7-8905-41a8-b224-984df64f278d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:00.804457 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-179d4c13-d5a2-4d97-9013-99a2f090a5ac req-849ee5e7-8905-41a8-b224-984df64f278d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.1143429 Dec 20 06:00:00.878073 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-fe841f9c-34e4-42d4-8ef5-af704b968bd8 None None] Set router 3f858ad2-b10f-4f04-9727-f99638a01796 gateway port host: None {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:00:00.889126 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-57e870fa-2ed9-4ddd-b2b9-831c991f45b7 admin admin] Router b6b6dd20-1b3b-4679-8eac-12000f450db9 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:00:00.908340 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-179d4c13-d5a2-4d97-9013-99a2f090a5ac req-9369e3e6-1209-4095-953b-25d4c673f140 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1024947 Dec 20 06:00:01.011852 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-fe841f9c-34e4-42d4-8ef5-af704b968bd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T06:00:00Z', 'revision_number': 6, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port_host': None}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:00:01.084878 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe841f9c-34e4-42d4-8ef5-af704b968bd8 None None] The sync data for ids ['3f858ad2-b10f-4f04-9727-f99638a01796'] in dv-cinder-822278-1-iscsi is: [{'id': '3f858ad2-b10f-4f04-9727-f99638a01796', 'name': 'tempest-AttachVolumeTestJSON-2143347886-router', 'tenant_id': '1898b7c1b3dc4523b09a97486622c67e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:53:24Z', 'updated_at': '2021-12-20T06:00:00Z', 'revision_number': 6, 'project_id': '1898b7c1b3dc4523b09a97486622c67e', 'gw_port_host': None}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:00:01.135685 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:01.172887 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-57e870fa-2ed9-4ddd-b2b9-831c991f45b7 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:00:01.185594 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81bad1bc-e0c2-4d6b-8b91-d580bdb1711e None None] Sync routers for ids ['b6b6dd20-1b3b-4679-8eac-12000f450db9'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:00:01.190279 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-57e870fa-2ed9-4ddd-b2b9-831c991f45b7 admin admin] 10.222.0.46 "PUT /v2.0/routers/b6b6dd20-1b3b-4679-8eac-12000f450db9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3496132 Dec 20 06:00:01.193286 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49170) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:01.200564 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] Pushing event deleted for resources: {'Port': ['ID=7b5cd9b9-b9f4-4ee3-a49d-93c291685413,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:01.204795 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81bad1bc-e0c2-4d6b-8b91-d580bdb1711e None None] Routers {'b6b6dd20-1b3b-4679-8eac-12000f450db9'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:00:01.205428 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-81bad1bc-e0c2-4d6b-8b91-d580bdb1711e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:59:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['b6b6dd20-1b3b-4679-8eac-12000f450db9'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:00:01.284441 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1703502'] for router_gateway, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:01.340350 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] Publish callbacks [] for router, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:01.406762 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1698526', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25973'] for router, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:01.409497 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:01.409896 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-81bad1bc-e0c2-4d6b-8b91-d580bdb1711e None None] Set router b6b6dd20-1b3b-4679-8eac-12000f450db9 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:00:01.549389 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:01.680706 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] Deleting port a343b7af-610a-4366-8d53-65e7d17efd82 {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:00:01.681056 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:01.741320 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-326e2e2a-2980-4c4b-9275-c3e7290c5ae9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:01.749800 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-81bad1bc-e0c2-4d6b-8b91-d580bdb1711e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'name': 'tempest-TestMinimumBasicScenario-223794928-router', 'tenant_id': 'e5f5841978a84626b73369bafc92e612', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.6'}], 'enable_snat': True}, 'gw_port_id': 'a343b7af-610a-4366-8d53-65e7d17efd82', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:38Z', 'updated_at': '2021-12-20T06:00:00Z', 'revision_number': 5, 'project_id': 'e5f5841978a84626b73369bafc92e612', 'gw_port': {'id': 'a343b7af-610a-4366-8d53-65e7d17efd82', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:14:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 496, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:56:39Z', 'updated_at': '2021-12-20T05:56:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:00:01.802962 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81bad1bc-e0c2-4d6b-8b91-d580bdb1711e None None] Checking router: b6b6dd20-1b3b-4679-8eac-12000f450db9 for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:00:01.821510 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81bad1bc-e0c2-4d6b-8b91-d580bdb1711e None None] Routers {'b6b6dd20-1b3b-4679-8eac-12000f450db9'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:00:01.823354 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-81bad1bc-e0c2-4d6b-8b91-d580bdb1711e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T05:59:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['b6b6dd20-1b3b-4679-8eac-12000f450db9'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:00:01.857467 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] For port a343b7af-610a-4366-8d53-65e7d17efd82, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=a343b7af-610a-4366-8d53-65e7d17efd82,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:00:01.857857 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:01.873180 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1698533'] for router, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:01.874822 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3f858ad2-b10f-4f04-9727-f99638a01796 {{(pid=102446) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 20 06:00:01.887604 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] Publish callbacks [] for router, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:01.895282 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49172) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:01.901456 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-b2d4317b-1d37-4d7d-be3b-406a6c8e8439 admin admin] 10.222.0.46 "DELETE /v2.0/routers/3f858ad2-b10f-4f04-9727-f99638a01796 HTTP/1.1" status: 204 len: 168 time: 1.7373617 Dec 20 06:00:01.912224 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] Calling delete_port for a343b7af-610a-4366-8d53-65e7d17efd82 owned by network:router_gateway {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:00:02.006913 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_v2 [None req-eae2b98f-7bd7-4434-bdb9-973a76475e26 admin admin] Deleting subnet ffb588f9-2ffb-4921-8a76-be5179c2fbed {{(pid=102445) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 06:00:02.025705 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-81bad1bc-e0c2-4d6b-8b91-d580bdb1711e None None] Set router b6b6dd20-1b3b-4679-8eac-12000f450db9 gateway port host: None {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:00:02.100726 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-eae2b98f-7bd7-4434-bdb9-973a76475e26 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:02.148969 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-81bad1bc-e0c2-4d6b-8b91-d580bdb1711e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'name': 'tempest-TestMinimumBasicScenario-223794928-router', 'tenant_id': 'e5f5841978a84626b73369bafc92e612', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:38Z', 'updated_at': '2021-12-20T06:00:01Z', 'revision_number': 6, 'project_id': 'e5f5841978a84626b73369bafc92e612', 'gw_port_host': None}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:00:02.216674 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 7b5cd9b9-b9f4-4ee3-a49d-93c291685413 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:00:02.220475 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81bad1bc-e0c2-4d6b-8b91-d580bdb1711e None None] The sync data for ids ['b6b6dd20-1b3b-4679-8eac-12000f450db9'] in dv-cinder-822278-1-iscsi is: [{'id': 'b6b6dd20-1b3b-4679-8eac-12000f450db9', 'name': 'tempest-TestMinimumBasicScenario-223794928-router', 'tenant_id': 'e5f5841978a84626b73369bafc92e612', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:56:38Z', 'updated_at': '2021-12-20T06:00:01Z', 'revision_number': 6, 'project_id': 'e5f5841978a84626b73369bafc92e612', 'gw_port_host': None}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:00:02.259666 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 7b5cd9b9-b9f4-4ee3-a49d-93c291685413 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:00:02.260012 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 7b5cd9b9-b9f4-4ee3-a49d-93c291685413 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:00:02.260447 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 313310c9-f961-4d30-aedb-324e4e6e1a26 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:00:02.296556 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 313310c9-f961-4d30-aedb-324e4e6e1a26 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:00:02.296556 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 313310c9-f961-4d30-aedb-324e4e6e1a26 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:00:02.361938 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-eae2b98f-7bd7-4434-bdb9-973a76475e26 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3457727'] for subnet, precommit_delete_associations {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:02.415743 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:02.456059 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] Pushing event deleted for resources: {'Port': ['ID=a343b7af-610a-4366-8d53-65e7d17efd82,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:02.496015 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0295fa2b-6c95-43c8-9438-7c0861752397 req-60e2a0ed-c204-4323-99ee-d36d4116ef84 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:02.497609 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0295fa2b-6c95-43c8-9438-7c0861752397 req-60e2a0ed-c204-4323-99ee-d36d4116ef84 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.4048598 Dec 20 06:00:02.561924 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-eae2b98f-7bd7-4434-bdb9-973a76475e26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:02.635052 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1703502'] for router_gateway, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:02.705437 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0295fa2b-6c95-43c8-9438-7c0861752397 req-0a7a7cf7-eeaa-4185-83de-785b7ee512cd tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1877098 Dec 20 06:00:02.744704 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1698526', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25973'] for router, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:02.747082 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:02.750867 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-eae2b98f-7bd7-4434-bdb9-973a76475e26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3465107', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3597782'] for subnet, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:02.815042 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eae2b98f-7bd7-4434-bdb9-973a76475e26 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ffb588f9-2ffb-4921-8a76-be5179c2fbed,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:02.821375 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-eae2b98f-7bd7-4434-bdb9-973a76475e26 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:02.823125 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-eae2b98f-7bd7-4434-bdb9-973a76475e26 admin admin] 10.222.0.46 "DELETE /v2.0/subnets/ffb588f9-2ffb-4921-8a76-be5179c2fbed HTTP/1.1" status: 204 len: 168 time: 0.9268634 Dec 20 06:00:02.825702 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49176) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:02.829770 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12e73629-276f-485f-9d45-732533648142 None None] Network 6924a88e-10c1-4073-a41c-88aad14ebd0f requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 06:00:02.834266 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1698533'] for router, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:02.834811 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] Fanout notify agent at l3_agent the message router_deleted on router b6b6dd20-1b3b-4679-8eac-12000f450db9 {{(pid=102445) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 20 06:00:02.850523 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] Publish callbacks [] for router, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:02.851700 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-55af0fba-3319-4c55-aa0c-bbdef6373549 admin admin] 10.222.0.46 "DELETE /v2.0/routers/b6b6dd20-1b3b-4679-8eac-12000f450db9 HTTP/1.1" status: 204 len: 168 time: 1.6569421 Dec 20 06:00:02.854563 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49178) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:02.907208 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:02.940556 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_v2 [None req-9699bb17-787a-4ffd-9205-1f4104125f9f admin admin] Deleting subnet 9b94b8c4-47a7-41ad-a245-a6b6ac0e356c {{(pid=102446) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 06:00:02.944704 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9699bb17-787a-4ffd-9205-1f4104125f9f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:02.981081 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Deleting port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:00:02.981081 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:02.984052 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9699bb17-787a-4ffd-9205-1f4104125f9f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8976279'] for subnet, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.054219 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] For port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=09374bc6-6f8e-4cbf-86e9-c35ec5fceb89,segment=NetworkSegment(4c69b482-aa23-4498-a353-7596fb491ef0),segment_id=4c69b482-aa23-4498-a353-7596fb491ef0)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:00:03.054219 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.068423 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Calling delete_port for 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 owned by network:dhcp {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:00:03.126784 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9699bb17-787a-4ffd-9205-1f4104125f9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.154714 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-072ec688-91c7-456c-9058-56c919a1276a None None] DHCP port deletion for 6924a88e-10c1-4073-a41c-88aad14ebd0f request from dv-cinder-822278-1-iscsi {{(pid=102447) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 20 06:00:03.198534 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.217839 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9699bb17-787a-4ffd-9205-1f4104125f9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9173344', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3270978'] for subnet, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.241899 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Pushing event deleted for resources: {'Port': ['ID=09374bc6-6f8e-4cbf-86e9-c35ec5fceb89,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:03.243354 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] No DVR routers for this DVR port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 on host dv-cinder-822278-1-iscsi {{(pid=102445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:00:03.286121 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-072ec688-91c7-456c-9058-56c919a1276a None None] Deleting port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 {{(pid=102447) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:00:03.286783 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-072ec688-91c7-456c-9058-56c919a1276a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.293013 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9699bb17-787a-4ffd-9205-1f4104125f9f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9b94b8c4-47a7-41ad-a245-a6b6ac0e356c,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:03.319968 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9699bb17-787a-4ffd-9205-1f4104125f9f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.326256 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-9699bb17-787a-4ffd-9205-1f4104125f9f admin admin] 10.222.0.46 "DELETE /v2.0/subnets/9b94b8c4-47a7-41ad-a245-a6b6ac0e356c HTTP/1.1" status: 204 len: 168 time: 0.4706671 Dec 20 06:00:03.327053 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c8eb29f-338b-492f-9665-5647f6c1e31d None None] Network 8c423773-73ba-4c57-a6d9-3e1edd7a4798 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 06:00:03.329004 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49180) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:03.354168 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.379432 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6924a88e-10c1-4073-a41c-88aad14ebd0f']}} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:00:03.404796 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4c69b482-aa23-4498-a353-7596fb491ef0') {'for_net_delete': True} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:00:03.405354 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4c69b482-aa23-4498-a353-7596fb491ef0') {} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:00:03.416191 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3457718'] for segment, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.426950 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-072ec688-91c7-456c-9058-56c919a1276a None None] For port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89, host dv-cinder-822278-1-iscsi, got binding levels [] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:00:03.427355 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-072ec688-91c7-456c-9058-56c919a1276a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.435665 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.442268 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.442544 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Releasing vlan 449 on physical network physnet1 to pool {{(pid=102445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 06:00:03.443093 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3465205'] for segment, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: Traceback (most recent call last): Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: timer() Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: cb(*args, **kw) Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: return func(*args, **kwargs) Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: self._notify() Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: self.callback(batched_events) Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: event.method(event) Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: return f(self, *a, **k) Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._get(url).json() Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: return self.request(url, 'GET', **kwargs) Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 06:00:03.446051 dv-cinder-822278-1-iscsi neutron-server[102445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 06:00:03.506588 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-072ec688-91c7-456c-9058-56c919a1276a None None] Calling delete_port for 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 owned by network:dhcp {{(pid=102447) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:00:03.520635 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.529884 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.539302 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] 10.222.0.46 "DELETE /v2.0/networks/6924a88e-10c1-4073-a41c-88aad14ebd0f HTTP/1.1" status: 204 len: 168 time: 0.7122450 Dec 20 06:00:03.554143 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf00fd1f-b23c-4354-9bab-c246fd021441 admin admin] Pushing event deleted for resources: {'Network': ['ID=6924a88e-10c1-4073-a41c-88aad14ebd0f,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:03.559330 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.ipam_backend_mixin [None req-072ec688-91c7-456c-9058-56c919a1276a None None] Port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 was not found and therefore no delete operation was performed {{(pid=102447) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 20 06:00:03.564867 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Deleting port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:00:03.565262 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-072ec688-91c7-456c-9058-56c919a1276a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340'] for port, after_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.565424 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.634104 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-072ec688-91c7-456c-9058-56c919a1276a None None] Network 6924a88e-10c1-4073-a41c-88aad14ebd0f is not hosted by any dhcp agent {{(pid=102447) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 20 06:00:03.635233 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-072ec688-91c7-456c-9058-56c919a1276a None None] No DVR routers for this DVR port 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 on host dv-cinder-822278-1-iscsi {{(pid=102447) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:00:03.676759 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] For port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=c6e563a3-8b01-4d5b-9e43-dcb1c258ac59,segment=NetworkSegment(1ae7591b-9735-4985-905b-489b2e4c5d48),segment_id=1ae7591b-9735-4985-905b-489b2e4c5d48)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:00:03.677152 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.681875 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-072ec688-91c7-456c-9058-56c919a1276a None None] Pushing event deleted for resources: {'Port': ['ID=09374bc6-6f8e-4cbf-86e9-c35ec5fceb89,revision_number=None']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:03.711770 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Calling delete_port for c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 owned by network:dhcp {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:00:03.719712 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49186) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:03.797579 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c21d1a5e-f36e-40dc-b2cb-58b2cd531e24 None None] DHCP port deletion for 8c423773-73ba-4c57-a6d9-3e1edd7a4798 request from dv-cinder-822278-1-iscsi {{(pid=102447) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 20 06:00:03.810175 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49190) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:03.818162 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-ec53a73e-71b3-40b5-b4d6-1ee300ebedce admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=1898b7c1b3dc4523b09a97486622c67e&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0962920 Dec 20 06:00:03.870760 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-c21d1a5e-f36e-40dc-b2cb-58b2cd531e24 None None] Deleting port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 {{(pid=102447) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:00:03.871393 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-c21d1a5e-f36e-40dc-b2cb-58b2cd531e24 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.892888 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:03.915404 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c905beef-f7db-4389-9bb4-9cb029db317b req-caa6cc46-b93d-4979-a911-2a4b54b9f0e5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:03.919713 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c905beef-f7db-4389-9bb4-9cb029db317b req-caa6cc46-b93d-4979-a911-2a4b54b9f0e5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0694880 Dec 20 06:00:03.942712 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Pushing event deleted for resources: {'Port': ['ID=c6e563a3-8b01-4d5b-9e43-dcb1c258ac59,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:03.967608 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] No DVR routers for this DVR port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 on host dv-cinder-822278-1-iscsi {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:00:03.985468 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c905beef-f7db-4389-9bb4-9cb029db317b req-8bcd8bb5-fbcc-4bcf-a480-c71e8e617b67 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0597620 Dec 20 06:00:04.029601 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-c21d1a5e-f36e-40dc-b2cb-58b2cd531e24 None None] For port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=c6e563a3-8b01-4d5b-9e43-dcb1c258ac59,segment=NetworkSegment(1ae7591b-9735-4985-905b-489b2e4c5d48),segment_id=1ae7591b-9735-4985-905b-489b2e4c5d48)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:00:04.030371 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-c21d1a5e-f36e-40dc-b2cb-58b2cd531e24 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.040157 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1fad5339-d149-437d-a94c-6040d9a3ede1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.061007 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-c21d1a5e-f36e-40dc-b2cb-58b2cd531e24 None None] Calling delete_port for c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 owned by network:dhcp {{(pid=102447) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:00:04.086975 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:00:04.089797 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.105742 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1fad5339-d149-437d-a94c-6040d9a3ede1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.124684 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8c423773-73ba-4c57-a6d9-3e1edd7a4798']}} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:00:04.156204 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1ae7591b-9735-4985-905b-489b2e4c5d48') {'for_net_delete': True} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:00:04.156521 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1ae7591b-9735-4985-905b-489b2e4c5d48') {} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:00:04.166283 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8976286'] for segment, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.166502 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:00:04.166784 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 0fdb5ab3-ae47-4202-a1e2-fe074e8b5730 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:00:04.167300 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device a343b7af-610a-4366-8d53-65e7d17efd82 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:00:04.183870 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.191989 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Releasing vlan 443 on physical network physnet1 to pool {{(pid=102446) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 06:00:04.192386 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9173254'] for segment, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: Traceback (most recent call last): Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: timer() Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: cb(*args, **kw) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: return func(*args, **kwargs) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: self._notify() Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: self.callback(batched_events) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: event.method(event) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: return f(self, *a, **k) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._get(url).json() Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: return self.request(url, 'GET', **kwargs) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 06:00:04.194110 dv-cinder-822278-1-iscsi neutron-server[102446]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 06:00:04.208234 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: a343b7af-610a-4366-8d53-65e7d17efd82 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:00:04.208766 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device a343b7af-610a-4366-8d53-65e7d17efd82 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:00:04.209500 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:00:04.226260 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1fad5339-d149-437d-a94c-6040d9a3ede1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.229337 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1fad5339-d149-437d-a94c-6040d9a3ede1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.230680 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-1fad5339-d149-437d-a94c-6040d9a3ede1 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/50504936-7d4c-4908-9138-fcb0de702a40 HTTP/1.1" status: 204 len: 168 time: 0.4182661 Dec 20 06:00:04.238032 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-0c804935-6e1f-4693-a7ab-79861c433fdd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.248978 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:00:04.249471 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:00:04.249716 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:00:04.279904 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:00:04.280355 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 09374bc6-6f8e-4cbf-86e9-c35ec5fceb89 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:00:04.310769 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-c21d1a5e-f36e-40dc-b2cb-58b2cd531e24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340'] for port, after_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.326707 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c21d1a5e-f36e-40dc-b2cb-58b2cd531e24 None None] No DVR routers for this DVR port c6e563a3-8b01-4d5b-9e43-dcb1c258ac59 on host dv-cinder-822278-1-iscsi {{(pid=102447) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:00:04.329865 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.337859 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.350101 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] 10.222.0.46 "DELETE /v2.0/networks/8c423773-73ba-4c57-a6d9-3e1edd7a4798 HTTP/1.1" status: 204 len: 168 time: 1.0170155 Dec 20 06:00:04.350298 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c21d1a5e-f36e-40dc-b2cb-58b2cd531e24 None None] Pushing event deleted for resources: {'Port': ['ID=c6e563a3-8b01-4d5b-9e43-dcb1c258ac59,revision_number=None']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:04.359651 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fad5339-d149-437d-a94c-6040d9a3ede1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=50504936-7d4c-4908-9138-fcb0de702a40,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:04.384287 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee08f1fd-2e49-4fdc-97a9-d3d6f561bd91 admin admin] Pushing event deleted for resources: {'Network': ['ID=8c423773-73ba-4c57-a6d9-3e1edd7a4798,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:04.558311 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49200) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:04.611814 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-0f2b0ae3-40ad-4036-90d3-cf9effdce921 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=627c52664e194163a380283ded298eb5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0512743 Dec 20 06:00:04.613351 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49202) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:04.669708 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-825547b5-69f6-460d-91c3-b63bda4835ef admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.691226 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-825547b5-69f6-460d-91c3-b63bda4835ef admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.748570 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-825547b5-69f6-460d-91c3-b63bda4835ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.751338 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-825547b5-69f6-460d-91c3-b63bda4835ef admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:04.760042 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-825547b5-69f6-460d-91c3-b63bda4835ef admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/4484ae16-a55f-40cc-bf6a-ad8ea50924e2 HTTP/1.1" status: 204 len: 168 time: 0.1382098 Dec 20 06:00:04.773619 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-825547b5-69f6-460d-91c3-b63bda4835ef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4484ae16-a55f-40cc-bf6a-ad8ea50924e2,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:04.970204 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:00:05.013689 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:05.115729 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49224) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:05.202146 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-36e031e3-65c4-4d0c-963b-561ea34a4b86 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=e5f5841978a84626b73369bafc92e612&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0843592 Dec 20 06:00:05.205048 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49228) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:05.234435 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc6bca10-bd71-470c-b18f-8302e49ff722 req-1c20d0b6-f9a1-4458-84b1-13d31d5cf30c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:05.242550 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fc6bca10-bd71-470c-b18f-8302e49ff722 req-1c20d0b6-f9a1-4458-84b1-13d31d5cf30c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.1102612 Dec 20 06:00:05.258747 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3c2de5ee-ddc6-4cb2-b0fc-5bd5a350a075 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:05.281563 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3c2de5ee-ddc6-4cb2-b0fc-5bd5a350a075 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:05.320440 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fc6bca10-bd71-470c-b18f-8302e49ff722 req-ddbcf82a-0688-4cf3-82ec-49456c03079a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0764208 Dec 20 06:00:05.350797 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3c2de5ee-ddc6-4cb2-b0fc-5bd5a350a075 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:05.353275 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-3c2de5ee-ddc6-4cb2-b0fc-5bd5a350a075 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:05.373584 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-3c2de5ee-ddc6-4cb2-b0fc-5bd5a350a075 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/6f86788c-75a6-4d42-a986-693f2f25a926 HTTP/1.1" status: 204 len: 168 time: 0.1593912 Dec 20 06:00:05.391774 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c2de5ee-ddc6-4cb2-b0fc-5bd5a350a075 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f86788c-75a6-4d42-a986-693f2f25a926,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:06.460619 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c1f9b73-03fe-4373-87a4-33e7e1796c0d req-bd8c1cd5-3410-40b1-b28e-8d273f04762b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:06.462168 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6c1f9b73-03fe-4373-87a4-33e7e1796c0d req-bd8c1cd5-3410-40b1-b28e-8d273f04762b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0556829 Dec 20 06:00:06.486592 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:06.511975 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6c1f9b73-03fe-4373-87a4-33e7e1796c0d req-38611b4f-9aaf-43b6-9623-0bb6c7635cd4 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436683 Dec 20 06:00:07.576168 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:07.646084 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f346eae-e9b5-4641-9ff7-d1153a38adbe req-3026d1f1-8a4a-49e6-9edd-ff9d62264985 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:07.647651 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2f346eae-e9b5-4641-9ff7-d1153a38adbe req-3026d1f1-8a4a-49e6-9edd-ff9d62264985 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0513995 Dec 20 06:00:07.699656 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2f346eae-e9b5-4641-9ff7-d1153a38adbe req-9925554c-dc1d-420a-ac80-152610c75520 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452368 Dec 20 06:00:08.485150 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49280) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:08.595141 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4fdfd0ca-b5af-4f7f-b0a1-d9e8630dd0e9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:08.680951 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4fdfd0ca-b5af-4f7f-b0a1-d9e8630dd0e9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:08.683208 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:08.685208 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-4fdfd0ca-b5af-4f7f-b0a1-d9e8630dd0e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:08.723459 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fdfd0ca-b5af-4f7f-b0a1-d9e8630dd0e9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5400a156-3e31-40a1-85e8-3513e9822c1d,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:08.728812 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-4fdfd0ca-b5af-4f7f-b0a1-d9e8630dd0e9 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=4fdcbff7aa43456992cc217329cc5298&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2425928 Dec 20 06:00:08.731728 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49286) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:08.819314 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-c6d71734-0b1e-4454-b976-900e88761e2a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:08.849333 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-c6d71734-0b1e-4454-b976-900e88761e2a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:08.867161 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cec7b21a-5390-462b-a9e0-0a1630e8d4b0 req-c73cdafe-b9c2-4c86-8a73-9210e074abc2 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:08.868708 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cec7b21a-5390-462b-a9e0-0a1630e8d4b0 req-c73cdafe-b9c2-4c86-8a73-9210e074abc2 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0875282 Dec 20 06:00:08.932264 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cec7b21a-5390-462b-a9e0-0a1630e8d4b0 req-5aa25c57-2ce2-479f-8491-678e840b73eb tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0562370 Dec 20 06:00:08.940105 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-c6d71734-0b1e-4454-b976-900e88761e2a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:08.943306 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-c6d71734-0b1e-4454-b976-900e88761e2a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:08.947295 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-c6d71734-0b1e-4454-b976-900e88761e2a admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/5400a156-3e31-40a1-85e8-3513e9822c1d HTTP/1.1" status: 204 len: 168 time: 0.2137489 Dec 20 06:00:08.956704 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6d71734-0b1e-4454-b976-900e88761e2a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5400a156-3e31-40a1-85e8-3513e9822c1d,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:10.081286 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c1e511-e2a9-4dca-9485-2893b2152be9 req-5dc58cfd-96f6-4fe8-af2b-a989bdfd7fcc tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:10.082864 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-97c1e511-e2a9-4dca-9485-2893b2152be9 req-5dc58cfd-96f6-4fe8-af2b-a989bdfd7fcc tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0589151 Dec 20 06:00:10.132974 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-97c1e511-e2a9-4dca-9485-2893b2152be9 req-ab3c1ec9-9928-49b8-950a-a26cbbea5c08 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437548 Dec 20 06:00:11.257024 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-011ff246-e0fe-4583-811e-7181366a07c7 req-694cdc7a-def1-4d5e-a148-f3d30a0db3d4 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:11.258488 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-011ff246-e0fe-4583-811e-7181366a07c7 req-694cdc7a-def1-4d5e-a148-f3d30a0db3d4 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0516045 Dec 20 06:00:11.308518 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-011ff246-e0fe-4583-811e-7181366a07c7 req-5dce475b-58a9-444b-a692-d58e90621f73 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442178 Dec 20 06:00:12.431939 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9d77c2d-f7e9-466b-abac-6effd85f1ceb req-e78f2960-2be1-47c5-9911-ca2a6ed973f7 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:12.433404 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c9d77c2d-f7e9-466b-abac-6effd85f1ceb req-e78f2960-2be1-47c5-9911-ca2a6ed973f7 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0488749 Dec 20 06:00:12.479456 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c9d77c2d-f7e9-466b-abac-6effd85f1ceb req-57949058-ae27-416d-9ab7-dc419f5cff8a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402253 Dec 20 06:00:13.598327 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-413ac5f1-41df-40eb-ad94-f3318cf79f9c req-093d68f7-430b-4a13-8fc5-cbdf862dc085 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:13.599804 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-413ac5f1-41df-40eb-ad94-f3318cf79f9c req-093d68f7-430b-4a13-8fc5-cbdf862dc085 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0508206 Dec 20 06:00:13.858228 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-413ac5f1-41df-40eb-ad94-f3318cf79f9c req-4a3225cb-d2fb-469e-931f-251660bc53b0 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2526319 Dec 20 06:00:14.975849 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f20ab52a-dd04-465b-a28b-7d81bfbf5358 req-83524cd8-799b-47f5-948f-0bb4a458ecff tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:14.977298 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f20ab52a-dd04-465b-a28b-7d81bfbf5358 req-83524cd8-799b-47f5-948f-0bb4a458ecff tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0474899 Dec 20 06:00:15.021582 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f20ab52a-dd04-465b-a28b-7d81bfbf5358 req-d5289f5d-6d57-402c-84ed-5b68591f3292 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385017 Dec 20 06:00:16.139756 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0893fdea-cddd-4603-b840-7a277704f3d4 req-44782268-ea80-420d-a4b5-10a187fee927 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:16.141201 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0893fdea-cddd-4603-b840-7a277704f3d4 req-44782268-ea80-420d-a4b5-10a187fee927 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0465760 Dec 20 06:00:16.188335 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0893fdea-cddd-4603-b840-7a277704f3d4 req-78f9b637-e847-4ace-98c3-d04a7bbe6f9a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405664 Dec 20 06:00:17.308623 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-928d2783-de8f-465c-81e7-c71be713dd4f req-d6251b22-599c-4bf4-aa41-4f2daf11e594 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:17.310109 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-928d2783-de8f-465c-81e7-c71be713dd4f req-d6251b22-599c-4bf4-aa41-4f2daf11e594 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0481822 Dec 20 06:00:17.374271 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-928d2783-de8f-465c-81e7-c71be713dd4f req-1dad47eb-c9ee-4fd9-8ecd-7005ffe32cea tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0582216 Dec 20 06:00:18.495570 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd1e8226-9d0e-458c-9c27-c27b02a34f66 req-4fe06c1c-719d-4d7d-b5c1-e42afcf1ef1a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:18.497025 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fd1e8226-9d0e-458c-9c27-c27b02a34f66 req-4fe06c1c-719d-4d7d-b5c1-e42afcf1ef1a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0477300 Dec 20 06:00:18.542354 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fd1e8226-9d0e-458c-9c27-c27b02a34f66 req-e4c8cf33-205a-4b06-bd8e-7ac6555094b4 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395446 Dec 20 06:00:19.666778 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15229747-8da8-4fd2-809d-d524b828cd88 req-cd42724d-651e-4e79-8122-2c1f89ce321a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:19.668252 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-15229747-8da8-4fd2-809d-d524b828cd88 req-cd42724d-651e-4e79-8122-2c1f89ce321a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0527692 Dec 20 06:00:19.723546 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-15229747-8da8-4fd2-809d-d524b828cd88 req-994d35ac-a8dd-4fb2-849e-372caeeaf238 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0494153 Dec 20 06:00:20.625554 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 9e825da9-eb60-4572-8a89-92caa8cddaa2 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 06:00:20.728203 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 9e825da9-eb60-4572-8a89-92caa8cddaa2, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:00:20.744301 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'port_id': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'mac_address': 'fa:16:3e:0a:87:10', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 414, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 06:00:20.780908 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:20.793267 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9e825da9-eb60-4572-8a89-92caa8cddaa2 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:00:20.812795 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 9e825da9-eb60-4572-8a89-92caa8cddaa2, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:00:20.816972 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:20.846539 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33a1a21c-486f-4643-8b25-b9858c8d4132 req-27df3220-1ce3-4a81-bf28-3d7c43f6cb79 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:20.848065 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-33a1a21c-486f-4643-8b25-b9858c8d4132 req-27df3220-1ce3-4a81-bf28-3d7c43f6cb79 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 944 time: 0.0497000 Dec 20 06:00:20.866565 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=9e825da9-eb60-4572-8a89-92caa8cddaa2,revision_number=9']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:20.894432 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-33a1a21c-486f-4643-8b25-b9858c8d4132 req-ac438ddf-b79b-401b-9bb6-f2749c409efc tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403669 Dec 20 06:00:21.156100 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['9e825da9-eb60-4572-8a89-92caa8cddaa2'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:00:22.018081 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d46ac6b-1b62-45f5-8708-f21c99767311 req-ba055878-2a74-43d4-81ac-94963a3ecab1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:22.019577 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4d46ac6b-1b62-45f5-8708-f21c99767311 req-ba055878-2a74-43d4-81ac-94963a3ecab1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 945 time: 0.0481758 Dec 20 06:00:22.070293 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4d46ac6b-1b62-45f5-8708-f21c99767311 req-6afbaa60-de37-437b-80cd-f16f51f900e6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441771 Dec 20 06:00:22.638261 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 9e825da9-eb60-4572-8a89-92caa8cddaa2 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 06:00:22.687788 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 9e825da9-eb60-4572-8a89-92caa8cddaa2 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 06:00:22.688089 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:22.760841 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:22.782753 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e825da9-eb60-4572-8a89-92caa8cddaa2'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:00:22.785550 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-904bce71-6153-4a1b-93ff-0307fdfbd78f" -d '{"events": [{"server_uuid": "8e0ee236-8474-4f2a-b875-752d3dec628f", "name": "network-vif-plugged", "status": "completed", "tag": "9e825da9-eb60-4572-8a89-92caa8cddaa2"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:00:22.801430 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 9e825da9-eb60-4572-8a89-92caa8cddaa2, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:00:22.809098 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:22.839725 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:00:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b46fa541-602d-4b2e-8a88-02ef7429f329 x-openstack-request-id: req-b46fa541-602d-4b2e-8a88-02ef7429f329 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:00:22.840260 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8e0ee236-8474-4f2a-b875-752d3dec628f", "name": "network-vif-plugged", "status": "completed", "tag": "9e825da9-eb60-4572-8a89-92caa8cddaa2", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:00:22.840678 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-b46fa541-602d-4b2e-8a88-02ef7429f329 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:00:22.841068 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'code': 200} Dec 20 06:00:22.867994 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=9e825da9-eb60-4572-8a89-92caa8cddaa2,revision_number=10']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:23.188041 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d1a9e63-0d5a-4753-965b-0163c646803d req-d022b537-5361-4d05-9292-81184510ebc8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:23.189540 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2d1a9e63-0d5a-4753-965b-0163c646803d req-d022b537-5361-4d05-9292-81184510ebc8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 947 time: 0.0475521 Dec 20 06:00:23.239407 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2d1a9e63-0d5a-4753-965b-0163c646803d req-2ca0b76f-ecc9-425a-ae63-a439de34d2db tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426829 Dec 20 06:00:23.385188 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c42e05-5f8a-4373-adba-6a5dcbecfb1e req-8fec5409-8fdb-46ce-a80e-444dbab667d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:23.386708 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-a5c42e05-5f8a-4373-adba-6a5dcbecfb1e req-8fec5409-8fdb-46ce-a80e-444dbab667d9 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 1100 time: 0.0381870 Dec 20 06:00:23.430253 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-a5c42e05-5f8a-4373-adba-6a5dcbecfb1e req-370d6eec-05e9-464c-8234-fc785e25fbcd service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0361495 Dec 20 06:00:24.380606 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b681747c-be9a-4cde-8595-18d2301256fb req-f047e615-bae6-48e3-906a-d63dd9a80fc5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:24.382170 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b681747c-be9a-4cde-8595-18d2301256fb req-f047e615-bae6-48e3-906a-d63dd9a80fc5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 947 time: 0.0616426 Dec 20 06:00:24.434232 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b681747c-be9a-4cde-8595-18d2301256fb req-0f877cf7-47ff-4017-a7a0-057387525fa4 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459955 Dec 20 06:00:25.557980 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6d7eeeb-63d6-4e99-bdff-a6c71ff5c44b req-747a09da-391f-484a-821b-718b9ff01c70 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:25.559641 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e6d7eeeb-63d6-4e99-bdff-a6c71ff5c44b req-747a09da-391f-484a-821b-718b9ff01c70 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 947 time: 0.0514371 Dec 20 06:00:25.607849 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e6d7eeeb-63d6-4e99-bdff-a6c71ff5c44b req-15633a9c-1731-488f-835b-e0ac4d9aad6a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419805 Dec 20 06:00:31.713776 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-fc70f1b7-05e1-41d1-b1c3-0fef056079f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:34.150144 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-2fb090f0-17b0-426c-9957-4acbb0cf2f2c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:34.992210 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:36.489797 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:37.570301 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:38.708512 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:41.971957 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:00:42.380968 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-629c559f-e68b-466a-9d2d-c8d7c4c76c88 req-c63867c9-6380-4498-991f-839d8bb962b3 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0408590 Dec 20 06:00:42.450805 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-629c559f-e68b-466a-9d2d-c8d7c4c76c88 req-88976b9f-e03e-4f72-bf05-334139165c88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:42.452293 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-629c559f-e68b-466a-9d2d-c8d7c4c76c88 req-88976b9f-e03e-4f72-bf05-334139165c88 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 1100 time: 0.0378606 Dec 20 06:00:42.552484 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-629c559f-e68b-466a-9d2d-c8d7c4c76c88 req-4a841a46-e43e-4221-8bc1-6e25971c8335 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:42.553929 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-629c559f-e68b-466a-9d2d-c8d7c4c76c88 req-4a841a46-e43e-4221-8bc1-6e25971c8335 service neutron] 10.222.0.54 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 917 time: 0.0820317 Dec 20 06:00:42.621552 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-629c559f-e68b-466a-9d2d-c8d7c4c76c88 req-a0fdb688-34f5-4cd5-bacc-a60222a7debc service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2 HTTP/1.1" status: 200 len: 1001 time: 0.0601912 Dec 20 06:00:42.671997 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-629c559f-e68b-466a-9d2d-c8d7c4c76c88 req-f3d6747c-ea19-48a9-aa63-51eacb186561 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:42.673490 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-629c559f-e68b-466a-9d2d-c8d7c4c76c88 req-f3d6747c-ea19-48a9-aa63-51eacb186561 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4b218758-bd28-403f-ac97-d980db9b78c8 HTTP/1.1" status: 200 len: 855 time: 0.0452137 Dec 20 06:00:42.718298 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-629c559f-e68b-466a-9d2d-c8d7c4c76c88 req-a0e421bb-5fb9-4019-be07-6ff3213966c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:00:42.719835 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-629c559f-e68b-466a-9d2d-c8d7c4c76c88 req-a0e421bb-5fb9-4019-be07-6ff3213966c5 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6623d855-6648-40fd-8a49-9c323edbff11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0392938 Dec 20 06:00:42.820643 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-629c559f-e68b-466a-9d2d-c8d7c4c76c88 req-f3eebcf8-8e0f-4830-82fb-6171cbfa577a service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0939734 Dec 20 06:00:42.920678 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-629c559f-e68b-466a-9d2d-c8d7c4c76c88 req-5d0d10f8-ae1c-4233-b21f-e5099174ba0f service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916395 Dec 20 06:00:51.459534 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49748) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:51.564739 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:51.636587 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:51.640156 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:51.677256 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=7c4a0a2317df406cbd9c281f35a2b951&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2166781 Dec 20 06:00:51.678086 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb55b73a-e5e8-49a7-8a79-921baf04f29e,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:51.680167 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49752) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:51.685130 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.685479 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.685820 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.686159 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.686487 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.686808 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.687132 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.687453 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.687801 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.688121 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.688440 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.688753 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.689067 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b7e522f-b700-4882-9efb-7ca12e6d4ff2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.728459 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:51.748701 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:51.793518 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:51.796219 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:51.797360 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/eb55b73a-e5e8-49a7-8a79-921baf04f29e HTTP/1.1" status: 204 len: 168 time: 0.1161642 Dec 20 06:00:51.804528 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb55b73a-e5e8-49a7-8a79-921baf04f29e,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:51.812620 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.812966 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.813307 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.813633 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.813961 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.814386 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.814609 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.814933 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.815258 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.815601 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.815920 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.816235 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:51.816553 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3caff9da-9275-4710-a507-d3ad7733344c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:00:52.060815 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49758) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:52.074081 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ac0400d3-73c5-41fc-9ced-f4662a0a1d4b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:52.157181 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ac0400d3-73c5-41fc-9ced-f4662a0a1d4b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:52.161239 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ac0400d3-73c5-41fc-9ced-f4662a0a1d4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:52.204607 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-ac0400d3-73c5-41fc-9ced-f4662a0a1d4b admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=41f1ec1b744645548c4df80a2bb92885&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1426914 Dec 20 06:00:52.205505 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac0400d3-73c5-41fc-9ced-f4662a0a1d4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c48b01dc-846c-4711-8131-0d23b7f5e09f,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:00:52.207222 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49760) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:00:52.255262 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-154df952-fe3e-448f-b8e6-d8600873444a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:52.275741 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-154df952-fe3e-448f-b8e6-d8600873444a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:52.321322 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-154df952-fe3e-448f-b8e6-d8600873444a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:52.323905 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-154df952-fe3e-448f-b8e6-d8600873444a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:00:52.325155 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-154df952-fe3e-448f-b8e6-d8600873444a admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/c48b01dc-846c-4711-8131-0d23b7f5e09f HTTP/1.1" status: 204 len: 168 time: 0.1168654 Dec 20 06:00:52.332911 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-154df952-fe3e-448f-b8e6-d8600873444a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c48b01dc-846c-4711-8131-0d23b7f5e09f,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:00.219728 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6476a43-0583-430a-be41-79a078f36f55 req-c0fa6f10-2ee4-4d51-8ed4-2ff60c769cca tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:00.221215 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d6476a43-0583-430a-be41-79a078f36f55 req-c0fa6f10-2ee4-4d51-8ed4-2ff60c769cca tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 947 time: 0.0488915 Dec 20 06:01:00.270024 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d6476a43-0583-430a-be41-79a078f36f55 req-ab752a4e-8587-462d-8bfe-0abb482caaf3 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428085 Dec 20 06:01:00.704670 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49918) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:00.805102 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-199c2ea5-7f39-4c36-9521-108e698799de admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:00.880879 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-199c2ea5-7f39-4c36-9521-108e698799de admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:00.884519 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-199c2ea5-7f39-4c36-9521-108e698799de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:00.921731 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-199c2ea5-7f39-4c36-9521-108e698799de admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=e817ecde4641406ba98b062f54548fe8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2160170 Dec 20 06:01:00.922536 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-199c2ea5-7f39-4c36-9521-108e698799de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86e91f9b-ecce-4d78-ac74-93d1ff63c35c,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:00.924484 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49922) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:00.971269 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-31dcc1a1-05d2-44ef-98dd-0bec52526d94 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:00.996517 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-31dcc1a1-05d2-44ef-98dd-0bec52526d94 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:01.044899 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-31dcc1a1-05d2-44ef-98dd-0bec52526d94 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:01.047475 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-31dcc1a1-05d2-44ef-98dd-0bec52526d94 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:01.048620 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-31dcc1a1-05d2-44ef-98dd-0bec52526d94 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/86e91f9b-ecce-4d78-ac74-93d1ff63c35c HTTP/1.1" status: 204 len: 168 time: 0.1231687 Dec 20 06:01:01.056445 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31dcc1a1-05d2-44ef-98dd-0bec52526d94 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86e91f9b-ecce-4d78-ac74-93d1ff63c35c,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:01.296552 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49928) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:01.309295 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3858292a-5a52-4e56-9a53-1fbfb652c639 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:01.420375 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c827cba4-30ce-45fd-ae51-3e36dcf928bb req-9209ac5b-5dac-4d86-bf20-1ff60483b747 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:01.421837 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c827cba4-30ce-45fd-ae51-3e36dcf928bb req-9209ac5b-5dac-4d86-bf20-1ff60483b747 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 947 time: 0.0765326 Dec 20 06:01:01.423603 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3858292a-5a52-4e56-9a53-1fbfb652c639 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:01.427428 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3858292a-5a52-4e56-9a53-1fbfb652c639 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:01.479979 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-3858292a-5a52-4e56-9a53-1fbfb652c639 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=cf1296327fed45b9b976754e4dc1b980&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1824205 Dec 20 06:01:01.480937 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3858292a-5a52-4e56-9a53-1fbfb652c639 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=324a2cc2-c53b-4e42-b953-a771c34453ce,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:01.482703 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49932) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:01.510062 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c827cba4-30ce-45fd-ae51-3e36dcf928bb req-7675b4f8-19f7-4bb2-a1a5-f914eb2b2122 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=6a99c56d-84ca-41c4-b5e3-94d98389342a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0799642 Dec 20 06:01:01.532714 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2305e505-72b8-43de-a1cf-8b03eff9f537 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:01.553530 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2305e505-72b8-43de-a1cf-8b03eff9f537 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:01.599361 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2305e505-72b8-43de-a1cf-8b03eff9f537 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:01.602017 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2305e505-72b8-43de-a1cf-8b03eff9f537 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:01.603159 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-2305e505-72b8-43de-a1cf-8b03eff9f537 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/324a2cc2-c53b-4e42-b953-a771c34453ce HTTP/1.1" status: 204 len: 168 time: 0.1193511 Dec 20 06:01:01.610671 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2305e505-72b8-43de-a1cf-8b03eff9f537 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=324a2cc2-c53b-4e42-b953-a771c34453ce,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:01.714971 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-bdeb9c80-b529-45e0-aeed-94d7ba5b9888 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:01.917408 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 49938) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:01.932295 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6d829531-246f-4a54-8d74-e3723dcb15e8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:02.012068 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17626e0c-226a-4f10-959f-2218b760e946 req-1b2afefb-871e-4d0a-bea9-5862298aefed tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:02.013521 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-17626e0c-226a-4f10-959f-2218b760e946 req-1b2afefb-871e-4d0a-bea9-5862298aefed tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.54 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 947 time: 0.0697751 Dec 20 06:01:02.099344 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6d829531-246f-4a54-8d74-e3723dcb15e8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:02.103399 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6d829531-246f-4a54-8d74-e3723dcb15e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:02.150200 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-6d829531-246f-4a54-8d74-e3723dcb15e8 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=35ef4b0682a1415d89969d4e2fe08692&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2315185 Dec 20 06:01:02.152897 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49940) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:02.153842 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d829531-246f-4a54-8d74-e3723dcb15e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b43f9e53-d923-4f82-a1a2-8a710ed7ee2a,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:02.163181 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-17626e0c-226a-4f10-959f-2218b760e946 req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Deleting port 9e825da9-eb60-4572-8a89-92caa8cddaa2 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:01:02.163537 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-17626e0c-226a-4f10-959f-2218b760e946 req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:02.205753 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-462879a1-1458-4517-8b84-666f344c50c3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:02.228578 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-462879a1-1458-4517-8b84-666f344c50c3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:02.257908 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-17626e0c-226a-4f10-959f-2218b760e946 req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] For port 9e825da9-eb60-4572-8a89-92caa8cddaa2, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9e825da9-eb60-4572-8a89-92caa8cddaa2,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:02.258273 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-17626e0c-226a-4f10-959f-2218b760e946 req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:02.279606 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-462879a1-1458-4517-8b84-666f344c50c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:02.282102 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-462879a1-1458-4517-8b84-666f344c50c3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:02.283240 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-462879a1-1458-4517-8b84-666f344c50c3 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/b43f9e53-d923-4f82-a1a2-8a710ed7ee2a HTTP/1.1" status: 204 len: 168 time: 0.1293676 Dec 20 06:01:02.291656 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-462879a1-1458-4517-8b84-666f344c50c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b43f9e53-d923-4f82-a1a2-8a710ed7ee2a,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:02.430036 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-17626e0c-226a-4f10-959f-2218b760e946 req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:02.430486 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-17626e0c-226a-4f10-959f-2218b760e946 req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:02.430800 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.l3_db [req-17626e0c-226a-4f10-959f-2218b760e946 req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Floating IP d251a20f-2a53-4fc5-b509-337fee6938ef disassociated. External IP: 172.27.3.15, port: 9e825da9-eb60-4572-8a89-92caa8cddaa2. Dec 20 06:01:02.431221 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-17626e0c-226a-4f10-959f-2218b760e946 req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Calling delete_port for 9e825da9-eb60-4572-8a89-92caa8cddaa2 owned by compute:nova {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:01:02.570171 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-17626e0c-226a-4f10-959f-2218b760e946 req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:02.602620 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event deleted for resources: {'Port': ['ID=9e825da9-eb60-4572-8a89-92caa8cddaa2,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:02.618668 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-011158c8-2928-4dfa-9367-39064821fcf2 req-8d6d4af1-b4a1-47b7-b3f6-15b10386fba4 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=8e0ee236-8474-4f2a-b875-752d3dec628f HTTP/1.1" status: 200 len: 210 time: 0.0284412 Dec 20 06:01:02.727302 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [req-17626e0c-226a-4f10-959f-2218b760e946 req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Router c3741b68-c75b-409c-9c20-6d6808f6e838 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:01:02.834568 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-17626e0c-226a-4f10-959f-2218b760e946 req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:01:02.845363 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c298094-f052-4f51-974b-2b655d085f3a None None] Sync routers for ids ['c3741b68-c75b-409c-9c20-6d6808f6e838'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:01:02.856583 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c298094-f052-4f51-974b-2b655d085f3a None None] Routers {'c3741b68-c75b-409c-9c20-6d6808f6e838'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:01:02.857617 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-3c298094-f052-4f51-974b-2b655d085f3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:00:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['c3741b68-c75b-409c-9c20-6d6808f6e838'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:02.872311 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-17626e0c-226a-4f10-959f-2218b760e946 req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] No DVR routers for this DVR port 9e825da9-eb60-4572-8a89-92caa8cddaa2 on host hv-cinder-82227 {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:01:02.875336 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-17626e0c-226a-4f10-959f-2218b760e946 req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:02.878809 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-17626e0c-226a-4f10-959f-2218b760e946 req-34fa214f-2bcc-4e77-ba0a-f2dac3f51b05 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.54 "DELETE /v2.0/ports/9e825da9-eb60-4572-8a89-92caa8cddaa2 HTTP/1.1" status: 204 len: 173 time: 0.8561623 Dec 20 06:01:02.879252 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'name': 'network-vif-deleted', 'tag': '9e825da9-eb60-4572-8a89-92caa8cddaa2'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:01:02.881496 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-21039a37-c778-4330-aac5-8807fdc1169c" -d '{"events": [{"server_uuid": "8e0ee236-8474-4f2a-b875-752d3dec628f", "name": "network-vif-deleted", "tag": "9e825da9-eb60-4572-8a89-92caa8cddaa2"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:01:02.921676 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:01:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-07aa5f29-55a4-48f5-8314-64d28d165e17 x-openstack-request-id: req-07aa5f29-55a4-48f5-8314-64d28d165e17 {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:01:02.922290 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8e0ee236-8474-4f2a-b875-752d3dec628f", "name": "network-vif-deleted", "tag": "9e825da9-eb60-4572-8a89-92caa8cddaa2", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:01:02.922290 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-07aa5f29-55a4-48f5-8314-64d28d165e17 {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:01:02.922890 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8e0ee236-8474-4f2a-b875-752d3dec628f', 'name': 'network-vif-deleted', 'tag': '9e825da9-eb60-4572-8a89-92caa8cddaa2', 'status': 'completed', 'code': 200} Dec 20 06:01:02.984814 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-3c298094-f052-4f51-974b-2b655d085f3a None None] Set router c3741b68-c75b-409c-9c20-6d6808f6e838 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:01:03.192853 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-3c298094-f052-4f51-974b-2b655d085f3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:17Z', 'revision_number': 5, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:03.223791 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c298094-f052-4f51-974b-2b655d085f3a None None] Checking router: c3741b68-c75b-409c-9c20-6d6808f6e838 for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:01:03.233731 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c298094-f052-4f51-974b-2b655d085f3a None None] Routers {'c3741b68-c75b-409c-9c20-6d6808f6e838'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:01:03.234341 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-3c298094-f052-4f51-974b-2b655d085f3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:00:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['c3741b68-c75b-409c-9c20-6d6808f6e838'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:03.348684 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-3c298094-f052-4f51-974b-2b655d085f3a None None] Set router c3741b68-c75b-409c-9c20-6d6808f6e838 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:01:03.561405 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-3c298094-f052-4f51-974b-2b655d085f3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:17Z', 'revision_number': 5, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:03.587945 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c298094-f052-4f51-974b-2b655d085f3a None None] The sync data for ids ['c3741b68-c75b-409c-9c20-6d6808f6e838'] in dv-cinder-822278-1-iscsi is: [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:17Z', 'revision_number': 5, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:01:03.718309 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 49990) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:03.785224 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-add1528a-2e85-41e0-baa6-a5331daed586 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:03.819310 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-add1528a-2e85-41e0-baa6-a5331daed586 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:03.862477 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-230f8989-f847-48bf-9bd8-29c558ca25c6 None None] New status for floating IP d251a20f-2a53-4fc5-b509-337fee6938ef: DOWN {{(pid=102447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 06:01:03.874584 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-add1528a-2e85-41e0-baa6-a5331daed586 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:03.878054 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-add1528a-2e85-41e0-baa6-a5331daed586 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:03.880224 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-add1528a-2e85-41e0-baa6-a5331daed586 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "DELETE /v2.0/security-groups/6a99c56d-84ca-41c4-b5e3-94d98389342a HTTP/1.1" status: 204 len: 168 time: 0.1597130 Dec 20 06:01:03.883771 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50006) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:03.901720 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.api.v2.resource [None req-99d86290-48e1-41e2-a362-8057302fb0ed tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] show failed (client error): The resource could not be found. Dec 20 06:01:03.903582 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-99d86290-48e1-41e2-a362-8057302fb0ed tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups/6a99c56d-84ca-41c4-b5e3-94d98389342a HTTP/1.1" status: 404 len: 347 time: 0.0185523 Dec 20 06:01:03.906346 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50012) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:03.908094 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-add1528a-2e85-41e0-baa6-a5331daed586 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a99c56d-84ca-41c4-b5e3-94d98389342a,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:04.056361 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-f51208d8-f935-4a85-9ac9-82b849508cc5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Deleting port ec8ae0eb-6f7d-40a8-8125-14fa48c27274 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:01:04.056856 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f51208d8-f935-4a85-9ac9-82b849508cc5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.133116 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f51208d8-f935-4a85-9ac9-82b849508cc5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.133485 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f51208d8-f935-4a85-9ac9-82b849508cc5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.146386 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-f51208d8-f935-4a85-9ac9-82b849508cc5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Calling delete_port for ec8ae0eb-6f7d-40a8-8125-14fa48c27274 owned by network:floatingip {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:01:04.154522 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-9fb6b5bd-6d7f-4c97-a41e-d9f2b563174f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.278296 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f51208d8-f935-4a85-9ac9-82b849508cc5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.304572 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f51208d8-f935-4a85-9ac9-82b849508cc5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event deleted for resources: {'Port': ['ID=ec8ae0eb-6f7d-40a8-8125-14fa48c27274,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:04.321756 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50028) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:04.362047 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f51208d8-f935-4a85-9ac9-82b849508cc5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for floatingip, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.364772 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f51208d8-f935-4a85-9ac9-82b849508cc5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.365939 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-f51208d8-f935-4a85-9ac9-82b849508cc5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "DELETE /v2.0/floatingips/d251a20f-2a53-4fc5-b509-337fee6938ef HTTP/1.1" status: 204 len: 168 time: 0.4571862 Dec 20 06:01:04.433821 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4b41f47c-14a6-49fd-8bb2-200941e2b31c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.507493 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4b41f47c-14a6-49fd-8bb2-200941e2b31c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.511087 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4b41f47c-14a6-49fd-8bb2-200941e2b31c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.546365 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b41f47c-14a6-49fd-8bb2-200941e2b31c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=36397e35-f259-4709-aba0-e4894b017ca2,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:04.553000 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-4b41f47c-14a6-49fd-8bb2-200941e2b31c admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=c99d42d068b74b2e9d93ba4562dd3940&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2277782 Dec 20 06:01:04.553289 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50034) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:04.600963 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-35bef7b0-c87f-484e-a4a7-adc159ef3087 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.621471 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-35bef7b0-c87f-484e-a4a7-adc159ef3087 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.628721 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50036) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:04.634037 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-ada9dbd4-c4d4-401e-9774-f3164f9d8a09 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Request body: {'security_group': {'name': 'tempest-securitygroup--617376129', 'description': 'tempest-description--807672937'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:01:04.658141 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ada9dbd4-c4d4-401e-9774-f3164f9d8a09 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.669606 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-35bef7b0-c87f-484e-a4a7-adc159ef3087 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.672422 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-35bef7b0-c87f-484e-a4a7-adc159ef3087 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.673606 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-35bef7b0-c87f-484e-a4a7-adc159ef3087 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/36397e35-f259-4709-aba0-e4894b017ca2 HTTP/1.1" status: 204 len: 168 time: 0.1193683 Dec 20 06:01:04.682046 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35bef7b0-c87f-484e-a4a7-adc159ef3087 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=36397e35-f259-4709-aba0-e4894b017ca2,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:04.733106 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ada9dbd4-c4d4-401e-9774-f3164f9d8a09 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.737845 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ada9dbd4-c4d4-401e-9774-f3164f9d8a09 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.766225 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ada9dbd4-c4d4-401e-9774-f3164f9d8a09 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.767460 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-ada9dbd4-c4d4-401e-9774-f3164f9d8a09 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.1377387 Dec 20 06:01:04.771220 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50040) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:04.776165 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-93066cbe-a517-4384-9ea4-ff788e43389b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Request body: {'security_group_rule': {'security_group_id': 'c39f6923-1297-48d1-8a30-e4715445fe4f', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:01:04.780372 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ada9dbd4-c4d4-401e-9774-f3164f9d8a09 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c39f6923-1297-48d1-8a30-e4715445fe4f,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:04.810168 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-93066cbe-a517-4384-9ea4-ff788e43389b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.854287 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 9e825da9-eb60-4572-8a89-92caa8cddaa2 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:01:04.867345 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-93066cbe-a517-4384-9ea4-ff788e43389b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.871156 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-93066cbe-a517-4384-9ea4-ff788e43389b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.874570 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: 9e825da9-eb60-4572-8a89-92caa8cddaa2 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:01:04.875119 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 9e825da9-eb60-4572-8a89-92caa8cddaa2 not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:01:04.891737 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93066cbe-a517-4384-9ea4-ff788e43389b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9434eae3-9916-4271-a567-8f7d7cc5906c,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:04.898232 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-93066cbe-a517-4384-9ea4-ff788e43389b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.899469 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-93066cbe-a517-4384-9ea4-ff788e43389b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1269825 Dec 20 06:01:04.903599 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50044) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:04.908323 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-1234cdcd-a2b3-43fd-9acc-77355af807d1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Request body: {'security_group_rule': {'security_group_id': 'c39f6923-1297-48d1-8a30-e4715445fe4f', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:01:04.945698 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1234cdcd-a2b3-43fd-9acc-77355af807d1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.959086 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50046) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:04.972391 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-41f305ba-e0f0-4ee3-8b18-b71e4e975f9d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:04.997297 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.004709 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1234cdcd-a2b3-43fd-9acc-77355af807d1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.008796 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1234cdcd-a2b3-43fd-9acc-77355af807d1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974522'] for security_group_rule, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.026404 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1234cdcd-a2b3-43fd-9acc-77355af807d1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d511f686-98ee-4973-9ab8-4a96b0e32136,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:05.041852 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-1234cdcd-a2b3-43fd-9acc-77355af807d1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.045921 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-1234cdcd-a2b3-43fd-9acc-77355af807d1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1384418 Dec 20 06:01:05.046150 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50048) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:05.050501 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Request body: {'floatingip': {'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:01:05.052714 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-41f305ba-e0f0-4ee3-8b18-b71e4e975f9d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.056622 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-41f305ba-e0f0-4ee3-8b18-b71e4e975f9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.074271 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for floatingip, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.095482 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-41f305ba-e0f0-4ee3-8b18-b71e4e975f9d admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=babc4098385747b2a9263d62a05e72b8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1347852 Dec 20 06:01:05.096372 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41f305ba-e0f0-4ee3-8b18-b71e4e975f9d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e5df03e-f0ee-4c51-998f-0a6494ab4ec7,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:05.098608 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50050) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:05.145445 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a5bbe98e-1ed7-4f30-b1a1-bdb8cf60cf59 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.166823 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a5bbe98e-1ed7-4f30-b1a1-bdb8cf60cf59 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.172946 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.221799 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a5bbe98e-1ed7-4f30-b1a1-bdb8cf60cf59 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.222021 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a5bbe98e-1ed7-4f30-b1a1-bdb8cf60cf59 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.223051 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-a5bbe98e-1ed7-4f30-b1a1-bdb8cf60cf59 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/5e5df03e-f0ee-4c51-998f-0a6494ab4ec7 HTTP/1.1" status: 204 len: 168 time: 0.1235559 Dec 20 06:01:05.234489 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5bbe98e-1ed7-4f30-b1a1-bdb8cf60cf59 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e5df03e-f0ee-4c51-998f-0a6494ab4ec7,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:05.293781 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Allocated IP 172.27.3.109 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/7c95581e-b88c-4f42-a0ab-fc0e2fb2b4de) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 06:01:05.400862 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.434533 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.480254 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 06:01:05.482988 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 06:01:05.485540 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 06:01:05.491321 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event updated for resources: {'Port': ['ID=7c95581e-b88c-4f42-a0ab-fc0e2fb2b4de,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:05.589313 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.625933 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.778238 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.783254 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.848469 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event updated for resources: {'Port': ['ID=7c95581e-b88c-4f42-a0ab-fc0e2fb2b4de,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:05.860833 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.877475 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:05.879989 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-32884ddc-7122-4e40-bfa3-5e6e495033e8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.8328001 Dec 20 06:01:06.074817 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-aab56198-e082-4e45-beb1-3e30bd42e088 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?name=tempest-securitygroup--617376129&fields=id&tenant_id=60c21858b1c7408daa963605a7c691c0 HTTP/1.1" status: 200 len: 267 time: 0.0437472 Dec 20 06:01:06.189383 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-23f57ffe-c056-4057-ba5d-56d7f243aae2 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:06.190868 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-23f57ffe-c056-4057-ba5d-56d7f243aae2 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 816 time: 0.1090088 Dec 20 06:01:06.205948 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-6da8252f-8c66-4d2b-8329-8f4f23352a5c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/quotas/60c21858b1c7408daa963605a7c691c0 HTTP/1.1" status: 200 len: 375 time: 0.0091815 Dec 20 06:01:06.259824 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-c67b32b8-2b18-485d-b865-4486a135d2ed tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0483563 Dec 20 06:01:06.360254 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-b27fb570-a146-4758-9ba5-48917ac67b34 service neutron] 10.222.0.46 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887802 Dec 20 06:01:06.453036 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-bfb8caac-22f9-4bfc-bd33-df5e54a59e27 service neutron] 10.222.0.46 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866473 Dec 20 06:01:06.494718 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:06.627410 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-fdd72ccc-5528-43c2-ad76-71bd4ab4cffe req-750778ea-8067-4da8-ba1a-3c7b42c9a42a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 210 time: 0.0349007 Dec 20 06:01:06.965020 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50120) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:07.301339 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-b2c1e1ea-0a98-4047-8ae1-07933e37052c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Deleting port 8f866994-2457-4068-82c3-05405dbc8a2a {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:01:07.302041 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b2c1e1ea-0a98-4047-8ae1-07933e37052c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:07.375931 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b2c1e1ea-0a98-4047-8ae1-07933e37052c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:07.376256 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b2c1e1ea-0a98-4047-8ae1-07933e37052c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:07.388304 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-b2c1e1ea-0a98-4047-8ae1-07933e37052c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Calling delete_port for 8f866994-2457-4068-82c3-05405dbc8a2a owned by network:floatingip {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:01:07.568628 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b2c1e1ea-0a98-4047-8ae1-07933e37052c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:07.580188 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:07.603132 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2c1e1ea-0a98-4047-8ae1-07933e37052c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Pushing event deleted for resources: {'Port': ['ID=8f866994-2457-4068-82c3-05405dbc8a2a,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:07.667734 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b2c1e1ea-0a98-4047-8ae1-07933e37052c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for floatingip, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:07.668038 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.l3_db [None req-b2c1e1ea-0a98-4047-8ae1-07933e37052c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Floating IP b8501923-1f23-40be-b7c2-664717a9978e disassociated (deleted). External IP: 172.27.3.178, port: 8a9f4386-7528-40a4-9b44-826be10f5c21. Dec 20 06:01:07.681617 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-819c373b-b84d-497f-924f-36af39208304 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:07.683429 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-819c373b-b84d-497f-924f-36af39208304 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.54 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 816 time: 0.1321695 Dec 20 06:01:07.757548 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-bb3c576f-bd0f-4be4-8f34-9ab5024583d7 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=60c21858b1c7408daa963605a7c691c0 HTTP/1.1" status: 200 len: 379 time: 0.0572269 Dec 20 06:01:07.766741 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-83a59216-050b-47f2-a892-037add802a9e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Request body: {'port': {'device_id': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'admin_state_up': True, 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'security_groups': ['c39f6923-1297-48d1-8a30-e4715445fe4f']}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:01:07.775299 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-10d68866-e4ed-4253-9e45-c94cb44b4d8f req-af4a19a8-141b-461d-a638-e6fbc6367add tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 210 time: 0.0566056 Dec 20 06:01:07.879080 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-83a59216-050b-47f2-a892-037add802a9e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Made reservation on behalf of 60c21858b1c7408daa963605a7c691c0 for: {'port': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 06:01:07.883146 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-83a59216-050b-47f2-a892-037add802a9e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:07.903823 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b2c1e1ea-0a98-4047-8ae1-07933e37052c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Router 728e739d-afec-42c9-b7f9-65837b18602c has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:01:08.011236 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-83a59216-050b-47f2-a892-037add802a9e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Allocated IP 172.20.0.14 (6623d855-6648-40fd-8a49-9c323edbff11/4b218758-bd28-403f-ac97-d980db9b78c8/e1d82060-6f66-481d-9c81-e9d5e1ed09f9) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 06:01:08.012360 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2c1e1ea-0a98-4047-8ae1-07933e37052c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:01:08.018438 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-b2c1e1ea-0a98-4047-8ae1-07933e37052c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:08.029172 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b1c8605-7104-45ea-b0be-c2b19e109d74 None None] Sync routers for ids ['728e739d-afec-42c9-b7f9-65837b18602c'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:01:08.044920 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b1c8605-7104-45ea-b0be-c2b19e109d74 None None] Routers {'728e739d-afec-42c9-b7f9-65837b18602c'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:01:08.045829 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-8b1c8605-7104-45ea-b0be-c2b19e109d74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:01:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['728e739d-afec-42c9-b7f9-65837b18602c'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:08.049174 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-b2c1e1ea-0a98-4047-8ae1-07933e37052c tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "DELETE /v2.0/floatingips/b8501923-1f23-40be-b7c2-664717a9978e HTTP/1.1" status: 204 len: 168 time: 1.0829678 Dec 20 06:01:08.049874 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'tag': '8a9f4386-7528-40a4-9b44-826be10f5c21'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:01:08.052073 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8eaed27e-5463-4580-9a05-0bb879c6f499" -d '{"events": [{"name": "network-changed", "server_uuid": "7f092569-f7b1-4e5d-859b-95ab2173d63f", "tag": "8a9f4386-7528-40a4-9b44-826be10f5c21"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:01:08.098803 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 06:01:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-70d5b52f-35c8-447c-857d-7faa04899209 x-openstack-request-id: req-70d5b52f-35c8-447c-857d-7faa04899209 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:01:08.099098 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7f092569-f7b1-4e5d-859b-95ab2173d63f", "tag": "8a9f4386-7528-40a4-9b44-826be10f5c21", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:01:08.099354 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-70d5b52f-35c8-447c-857d-7faa04899209 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:01:08.099802 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'tag': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'status': 'completed', 'code': 200} Dec 20 06:01:08.201508 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-8b1c8605-7104-45ea-b0be-c2b19e109d74 None None] Set router 728e739d-afec-42c9-b7f9-65837b18602c gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:01:08.215234 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-83a59216-050b-47f2-a892-037add802a9e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:08.226458 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eaed27e-5463-4580-9a05-0bb879c6f499 req-2fc5796c-6ab5-4185-b578-c4f6af6f3681 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:08.232810 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8eaed27e-5463-4580-9a05-0bb879c6f499 req-2fc5796c-6ab5-4185-b578-c4f6af6f3681 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=a67a7ba727e54b1c9f6ca2d5ea21f272&device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 1098 time: 0.0844834 Dec 20 06:01:08.293757 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-83a59216-050b-47f2-a892-037add802a9e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:08.370159 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83a59216-050b-47f2-a892-037add802a9e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event updated for resources: {'Port': ['ID=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:08.384283 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-83a59216-050b-47f2-a892-037add802a9e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Network 6623d855-6648-40fd-8a49-9c323edbff11 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 06:01:08.386875 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-83a59216-050b-47f2-a892-037add802a9e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 06:01:08.396709 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-83a59216-050b-47f2-a892-037add802a9e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 06:01:08.447498 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7defcc27-c6fc-4f8e-a688-bc40d5729ca8 req-1951dd08-b1ef-4a4e-bbec-f7f609543fcc tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:08.449117 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7defcc27-c6fc-4f8e-a688-bc40d5729ca8 req-1951dd08-b1ef-4a4e-bbec-f7f609543fcc tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.1019840 Dec 20 06:01:08.450197 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eaed27e-5463-4580-9a05-0bb879c6f499 req-02c9c5b2-9680-448a-8075-9355a731e306 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:08.451598 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8eaed27e-5463-4580-9a05-0bb879c6f499 req-02c9c5b2-9680-448a-8075-9355a731e306 service neutron] 10.222.0.54 "GET /v2.0/networks?id=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 HTTP/1.1" status: 200 len: 910 time: 0.2125127 Dec 20 06:01:08.485501 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-83a59216-050b-47f2-a892-037add802a9e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:08.486257 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-83a59216-050b-47f2-a892-037add802a9e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:08.505610 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-83a59216-050b-47f2-a892-037add802a9e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7423730 Dec 20 06:01:08.524448 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Request body: {'port': {'device_id': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:01:08.535380 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8eaed27e-5463-4580-9a05-0bb879c6f499 req-4a417d88-3f98-4a77-b491-d88d6074752d service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=8a9f4386-7528-40a4-9b44-826be10f5c21 HTTP/1.1" status: 200 len: 217 time: 0.0534208 Dec 20 06:01:08.591019 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:08.603562 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7defcc27-c6fc-4f8e-a688-bc40d5729ca8 req-f3db1c4f-9765-4251-90f9-cc941e565c0b tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1402545 Dec 20 06:01:08.618998 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eaed27e-5463-4580-9a05-0bb879c6f499 req-18379fd4-af8f-4f2e-8603-bdac9517bf3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:08.620873 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8eaed27e-5463-4580-9a05-0bb879c6f499 req-18379fd4-af8f-4f2e-8603-bdac9517bf3b service neutron] 10.222.0.54 "GET /v2.0/subnets?id=a2b892f1-223d-4384-8544-8bbbbe5c621b HTTP/1.1" status: 200 len: 848 time: 0.0759625 Dec 20 06:01:08.623585 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-8b1c8605-7104-45ea-b0be-c2b19e109d74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28'}], 'enable_snat': True}, 'gw_port_id': '973d22fc-4c72-4242-98d2-520773fe8892', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:53Z', 'revision_number': 4, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port': {'id': '973d22fc-4c72-4242-98d2-520773fe8892', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:1e:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '43066bfd-26eb-4a35-9f53-02e9ff2e6c84', 'name': '', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'mac_address': 'fa:16:3e:6c:72:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:53Z', 'updated_at': '2021-12-20T05:55:58Z', 'revision_number': 5, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'subnets': [{'id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:08.651021 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b1c8605-7104-45ea-b0be-c2b19e109d74 None None] Checking router: 728e739d-afec-42c9-b7f9-65837b18602c for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:01:08.660002 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b1c8605-7104-45ea-b0be-c2b19e109d74 None None] Routers {'728e739d-afec-42c9-b7f9-65837b18602c'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:01:08.660846 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-8b1c8605-7104-45ea-b0be-c2b19e109d74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:01:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['728e739d-afec-42c9-b7f9-65837b18602c'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:08.683378 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eaed27e-5463-4580-9a05-0bb879c6f499 req-71605c38-aed0-4c66-8079-9554a5df6433 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:08.684947 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8eaed27e-5463-4580-9a05-0bb879c6f499 req-71605c38-aed0-4c66-8079-9554a5df6433 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0540428 Dec 20 06:01:08.698731 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:08.717020 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-9436e388-941b-402b-979f-a04b363d4904 None None] Provisioning complete for port e1d82060-6f66-481d-9c81-e9d5e1ed09f9 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 06:01:08.717624 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-9436e388-941b-402b-979f-a04b363d4904 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:08.753615 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-9436e388-941b-402b-979f-a04b363d4904 None None] Port e1d82060-6f66-481d-9c81-e9d5e1ed09f9 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 06:01:08.780340 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-8b1c8605-7104-45ea-b0be-c2b19e109d74 None None] Set router 728e739d-afec-42c9-b7f9-65837b18602c gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:01:08.789299 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8eaed27e-5463-4580-9a05-0bb879c6f499 req-fc6c84ce-7f94-4454-8f3e-7d833ac99010 service neutron] 10.222.0.54 "GET /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0953162 Dec 20 06:01:08.902600 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e1d82060-6f66-481d-9c81-e9d5e1ed09f9 {{(pid=102446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:01:08.912014 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:08.915936 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8eaed27e-5463-4580-9a05-0bb879c6f499 req-5a3c55a5-3cf0-4a2e-9b7f-fa15549622e8 service neutron] 10.222.0.54 "GET /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1193483 Dec 20 06:01:08.925033 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.provisioning_blocks [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Transition to ACTIVE for port object e1d82060-6f66-481d-9c81-e9d5e1ed09f9 will not be triggered until provisioned by entity L2. {{(pid=102446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 06:01:08.929234 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:08.935066 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47132051-b02b-4932-a99d-3cb1200045e4 req-1b92aaaa-0f80-42f8-bd5f-22b0afd6e624 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:08.936954 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-47132051-b02b-4932-a99d-3cb1200045e4 req-1b92aaaa-0f80-42f8-bd5f-22b0afd6e624 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 932 time: 0.0619593 Dec 20 06:01:08.996878 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-47132051-b02b-4932-a99d-3cb1200045e4 req-0dac085e-9f1a-4390-9d40-0927e12a2bb6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0516686 Dec 20 06:01:08.999502 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Pushing event updated for resources: {'Port': ['ID=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:09.026890 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-8b1c8605-7104-45ea-b0be-c2b19e109d74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28'}], 'enable_snat': True}, 'gw_port_id': '973d22fc-4c72-4242-98d2-520773fe8892', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:53Z', 'revision_number': 4, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port': {'id': '973d22fc-4c72-4242-98d2-520773fe8892', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:1e:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '43066bfd-26eb-4a35-9f53-02e9ff2e6c84', 'name': '', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'mac_address': 'fa:16:3e:6c:72:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:53Z', 'updated_at': '2021-12-20T05:55:58Z', 'revision_number': 5, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'subnets': [{'id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:09.058120 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b1c8605-7104-45ea-b0be-c2b19e109d74 None None] The sync data for ids ['728e739d-afec-42c9-b7f9-65837b18602c'] in dv-cinder-822278-1-iscsi is: [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28'}], 'enable_snat': True}, 'gw_port_id': '973d22fc-4c72-4242-98d2-520773fe8892', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:53Z', 'revision_number': 4, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port': {'id': '973d22fc-4c72-4242-98d2-520773fe8892', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:1e:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '43066bfd-26eb-4a35-9f53-02e9ff2e6c84', 'name': '', 'network_id': '0dda46a2-d87a-46ca-89fc-3cf651bd2fc3', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'mac_address': 'fa:16:3e:6c:72:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:53Z', 'updated_at': '2021-12-20T05:55:58Z', 'revision_number': 5, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'subnets': [{'id': 'a2b892f1-223d-4384-8544-8bbbbe5c621b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:01:09.072258 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Attempting to bind port e1d82060-6f66-481d-9c81-e9d5e1ed09f9 on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 06:01:09.072602 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Attempting to bind port e1d82060-6f66-481d-9c81-e9d5e1ed09f9 by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'}] {{(pid=102446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 06:01:09.072960 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Attempting to bind port e1d82060-6f66-481d-9c81-e9d5e1ed09f9 on network 6623d855-6648-40fd-8a49-9c323edbff11 {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 06:01:09.078819 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Port e1d82060-6f66-481d-9c81-e9d5e1ed09f9 on network 6623d855-6648-40fd-8a49-9c323edbff11 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 06:01:09.079147 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Attempting to bind port e1d82060-6f66-481d-9c81-e9d5e1ed09f9 on network 6623d855-6648-40fd-8a49-9c323edbff11 {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 06:01:09.084402 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 6, 1, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 06:01:09.086511 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Checking segment: {'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 06:01:09.087156 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Bound using segment: {'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'} {{(pid=102446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 06:01:09.087891 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.managers [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Bound port: e1d82060-6f66-481d-9c81-e9d5e1ed09f9, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c44c7219-40a7-4f55-8e90-10f68acf14be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11'}}] {{(pid=102446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 06:01:09.088506 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:09.158373 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] For port e1d82060-6f66-481d-9c81-e9d5e1ed09f9, host hv-cinder-82227, cleared binding levels {{(pid=102446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 06:01:09.161374 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] For port e1d82060-6f66-481d-9c81-e9d5e1ed09f9, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 06:01:09.166719 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:09.199196 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:09.199812 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:09.201389 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] 10.222.0.54 "PUT /v2.0/ports/e1d82060-6f66-481d-9c81-e9d5e1ed09f9 HTTP/1.1" status: 200 len: 1094 time: 0.6819036 Dec 20 06:01:09.204289 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'tag': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:01:09.206284 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7da3452f-f7c2-4063-82d0-be7a68284f95" -d '{"events": [{"name": "network-changed", "server_uuid": "accc1938-7113-4752-b1cb-e7b9b1c5b96f", "tag": "e1d82060-6f66-481d-9c81-e9d5e1ed09f9"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:01:09.233657 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cf73b44-4d47-4a9d-807c-187cb337d06c service neutron] Pushing event updated for resources: {'Port': ['ID=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,revision_number=3']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:09.267696 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 06:01:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-60d021f3-7d2e-4a06-827d-333efd3617b9 x-openstack-request-id: req-60d021f3-7d2e-4a06-827d-333efd3617b9 {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:01:09.267990 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "accc1938-7113-4752-b1cb-e7b9b1c5b96f", "tag": "e1d82060-6f66-481d-9c81-e9d5e1ed09f9", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:01:09.268244 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-60d021f3-7d2e-4a06-827d-333efd3617b9 {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:01:09.268644 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'tag': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'status': 'completed', 'code': 200} Dec 20 06:01:09.337679 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc9f49e4-b5a9-4719-a98c-c273736ae6b7 None None] New status for floating IP b8501923-1f23-40be-b7c2-664717a9978e: DOWN {{(pid=102447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 06:01:09.591551 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-a480d40e-3351-4b10-8eef-9d4cb458f259 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:09.593051 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-a480d40e-3351-4b10-8eef-9d4cb458f259 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 1097 time: 0.3035243 Dec 20 06:01:09.647183 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-0afac9cc-b05d-4609-af9f-16cc5a484aea service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9 HTTP/1.1" status: 200 len: 217 time: 0.0376010 Dec 20 06:01:09.715469 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-44136bb3-064e-4646-a07e-4ce954811f28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:09.715702 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-870fd935-306e-484a-a9b4-6b5c3bc2738e req-7e7662b3-aa1d-4aa2-bd9a-d852a1d54492 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:09.716971 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-44136bb3-064e-4646-a07e-4ce954811f28 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4b218758-bd28-403f-ac97-d980db9b78c8 HTTP/1.1" status: 200 len: 855 time: 0.0519006 Dec 20 06:01:09.717248 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-870fd935-306e-484a-a9b4-6b5c3bc2738e req-7e7662b3-aa1d-4aa2-bd9a-d852a1d54492 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0501406 Dec 20 06:01:09.770726 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-870fd935-306e-484a-a9b4-6b5c3bc2738e req-b38d5f74-3bb5-408c-9570-8836088ccb4a tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/security-groups?id=0ee7077b-2ff5-4a83-bf29-d30984dea2c7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463257 Dec 20 06:01:09.774416 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-625e34c1-7b85-4f3f-a202-bb59b99e5c2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:09.775942 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-625e34c1-7b85-4f3f-a202-bb59b99e5c2d service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6623d855-6648-40fd-8a49-9c323edbff11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0505838 Dec 20 06:01:09.871850 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-d54f1f32-f04c-4254-8d57-f73d0f93dd90 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860438 Dec 20 06:01:09.964613 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-02feb13a-91d4-4de0-be6d-9c6e3e1b5dd7 req-262e3f36-0709-4a6e-ba6a-384fd0c8f1ca service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832455 Dec 20 06:01:10.130162 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1de7643d-2839-4bab-9747-62fec81e3e03 req-bc3d46db-5da8-4837-96e6-802020863606 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:10.131717 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1de7643d-2839-4bab-9747-62fec81e3e03 req-bc3d46db-5da8-4837-96e6-802020863606 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0535684 Dec 20 06:01:10.167307 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0371b49e-3500-49d3-bee3-a87f2c0486b0 req-daa15371-6b9f-40b4-9036-27bfebf23396 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:10.168785 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-0371b49e-3500-49d3-bee3-a87f2c0486b0 req-daa15371-6b9f-40b4-9036-27bfebf23396 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.54 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 945 time: 0.0503571 Dec 20 06:01:10.205623 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7da3452f-f7c2-4063-82d0-be7a68284f95 req-6e944ae1-aa7d-4a5a-a7ee-f35850e29ec8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:10.207098 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7da3452f-f7c2-4063-82d0-be7a68284f95 req-6e944ae1-aa7d-4a5a-a7ee-f35850e29ec8 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 1097 time: 0.0702038 Dec 20 06:01:10.211006 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1de7643d-2839-4bab-9747-62fec81e3e03 req-b9443f6b-48b8-42e2-965d-351dbb1d57ea tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0669963 Dec 20 06:01:10.268478 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-0371b49e-3500-49d3-bee3-a87f2c0486b0 req-683897ac-0c9b-4414-bef4-f556363c31f8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Deleting port 8a9f4386-7528-40a4-9b44-826be10f5c21 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:01:10.268820 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-0371b49e-3500-49d3-bee3-a87f2c0486b0 req-683897ac-0c9b-4414-bef4-f556363c31f8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:10.302257 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7da3452f-f7c2-4063-82d0-be7a68284f95 req-82aac3e5-bd91-4ed5-9b4a-fd576bd860ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:10.303785 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7da3452f-f7c2-4063-82d0-be7a68284f95 req-82aac3e5-bd91-4ed5-9b4a-fd576bd860ab service neutron] 10.222.0.54 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 917 time: 0.0897496 Dec 20 06:01:10.345920 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7da3452f-f7c2-4063-82d0-be7a68284f95 req-c5093287-6cff-4ed9-b431-65c811336271 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9 HTTP/1.1" status: 200 len: 217 time: 0.0344031 Dec 20 06:01:10.357842 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [req-0371b49e-3500-49d3-bee3-a87f2c0486b0 req-683897ac-0c9b-4414-bef4-f556363c31f8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] For port 8a9f4386-7528-40a4-9b44-826be10f5c21, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=8a9f4386-7528-40a4-9b44-826be10f5c21,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:10.358200 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-0371b49e-3500-49d3-bee3-a87f2c0486b0 req-683897ac-0c9b-4414-bef4-f556363c31f8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:10.370442 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [req-0371b49e-3500-49d3-bee3-a87f2c0486b0 req-683897ac-0c9b-4414-bef4-f556363c31f8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Calling delete_port for 8a9f4386-7528-40a4-9b44-826be10f5c21 owned by compute:nova {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:01:10.393859 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7da3452f-f7c2-4063-82d0-be7a68284f95 req-8163a2be-2117-43e7-b277-da0e1c995c8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:10.395357 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7da3452f-f7c2-4063-82d0-be7a68284f95 req-8163a2be-2117-43e7-b277-da0e1c995c8c service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4b218758-bd28-403f-ac97-d980db9b78c8 HTTP/1.1" status: 200 len: 855 time: 0.0418029 Dec 20 06:01:10.444097 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7da3452f-f7c2-4063-82d0-be7a68284f95 req-0ec4a868-329c-465e-8493-e0661a98ff47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:10.445578 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7da3452f-f7c2-4063-82d0-be7a68284f95 req-0ec4a868-329c-465e-8493-e0661a98ff47 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6623d855-6648-40fd-8a49-9c323edbff11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0422616 Dec 20 06:01:10.497286 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-0371b49e-3500-49d3-bee3-a87f2c0486b0 req-683897ac-0c9b-4414-bef4-f556363c31f8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:10.526057 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-683897ac-0c9b-4414-bef4-f556363c31f8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Pushing event deleted for resources: {'Port': ['ID=8a9f4386-7528-40a4-9b44-826be10f5c21,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:10.536462 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7da3452f-f7c2-4063-82d0-be7a68284f95 req-02371706-de40-4080-b1f1-05070b4439c3 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816371 Dec 20 06:01:10.566455 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [req-0371b49e-3500-49d3-bee3-a87f2c0486b0 req-683897ac-0c9b-4414-bef4-f556363c31f8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] No DVR routers for this DVR port 8a9f4386-7528-40a4-9b44-826be10f5c21 on host hv-cinder-82227 {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:01:10.569720 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [req-0371b49e-3500-49d3-bee3-a87f2c0486b0 req-683897ac-0c9b-4414-bef4-f556363c31f8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:10.573110 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-0371b49e-3500-49d3-bee3-a87f2c0486b0 req-683897ac-0c9b-4414-bef4-f556363c31f8 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.54 "DELETE /v2.0/ports/8a9f4386-7528-40a4-9b44-826be10f5c21 HTTP/1.1" status: 204 len: 173 time: 0.3960714 Dec 20 06:01:10.637491 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7da3452f-f7c2-4063-82d0-be7a68284f95 req-b8d77b6a-f68a-415b-8a6f-4bfc6b15ca40 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0935385 Dec 20 06:01:10.872066 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-24467376-96d4-4e40-97bc-906b942573de req-58c81c15-c31e-4f0e-9d9e-888cd2926e92 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "GET /v2.0/ports?device_id=7f092569-f7b1-4e5d-859b-95ab2173d63f HTTP/1.1" status: 200 len: 210 time: 0.0315809 Dec 20 06:01:11.269373 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'name': 'network-vif-deleted', 'tag': '8a9f4386-7528-40a4-9b44-826be10f5c21'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:01:11.271857 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a1fe69b5-b872-46b7-8393-344f790e7a7c" -d '{"events": [{"server_uuid": "7f092569-f7b1-4e5d-859b-95ab2173d63f", "name": "network-vif-deleted", "tag": "8a9f4386-7528-40a4-9b44-826be10f5c21"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:01:11.318363 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:01:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-46bc382d-75b4-44aa-9781-6a17b07d62df x-openstack-request-id: req-46bc382d-75b4-44aa-9781-6a17b07d62df {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:01:11.318657 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7f092569-f7b1-4e5d-859b-95ab2173d63f", "name": "network-vif-deleted", "tag": "8a9f4386-7528-40a4-9b44-826be10f5c21", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:01:11.319504 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-46bc382d-75b4-44aa-9781-6a17b07d62df {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:01:11.320017 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7f092569-f7b1-4e5d-859b-95ab2173d63f', 'name': 'network-vif-deleted', 'tag': '8a9f4386-7528-40a4-9b44-826be10f5c21', 'status': 'completed', 'code': 200} Dec 20 06:01:11.338906 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10644a47-1487-4869-9e25-f66e990eb2ff req-ab4e456c-f0e9-40c0-a6e0-341c983987f8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:11.340445 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-10644a47-1487-4869-9e25-f66e990eb2ff req-ab4e456c-f0e9-40c0-a6e0-341c983987f8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0522082 Dec 20 06:01:11.393986 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-10644a47-1487-4869-9e25-f66e990eb2ff req-52115828-a047-4c72-931d-cc19920a4b76 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471284 Dec 20 06:01:11.929935 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50184) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:11.986682 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-0abeb594-71b4-4613-be7b-0928a55960e4 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:12.014063 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-0abeb594-71b4-4613-be7b-0928a55960e4 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:12.070612 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-0abeb594-71b4-4613-be7b-0928a55960e4 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:12.073621 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-0abeb594-71b4-4613-be7b-0928a55960e4 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:12.074762 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-0abeb594-71b4-4613-be7b-0928a55960e4 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] 10.222.0.46 "DELETE /v2.0/security-groups/0ee7077b-2ff5-4a83-bf29-d30984dea2c7 HTTP/1.1" status: 204 len: 168 time: 0.1438496 Dec 20 06:01:12.086143 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0abeb594-71b4-4613-be7b-0928a55960e4 tempest-TestShelveInstance-1724540419 tempest-TestShelveInstance-1724540419-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ee7077b-2ff5-4a83-bf29-d30984dea2c7,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:12.124340 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50188) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:12.728841 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559cc5ab-7e19-4f71-8a99-db0ef8d5c5e9 req-9622cac9-93f5-4cab-9b91-a656f61231f9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:12.730194 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-559cc5ab-7e19-4f71-8a99-db0ef8d5c5e9 req-9622cac9-93f5-4cab-9b91-a656f61231f9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0794270 Dec 20 06:01:12.805950 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-559cc5ab-7e19-4f71-8a99-db0ef8d5c5e9 req-b6cb7d9d-ad2e-4ab6-b671-0c1dc45f84af tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0694859 Dec 20 06:01:12.877915 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e0ee5752-0fdb-41ce-97a8-655fb56b6c8a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1697024'] for router_interface, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:12.901873 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device e1d82060-6f66-481d-9c81-e9d5e1ed09f9 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 06:01:12.914121 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 8a9f4386-7528-40a4-9b44-826be10f5c21 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:01:12.940045 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: 8a9f4386-7528-40a4-9b44-826be10f5c21 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:01:12.940504 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 8a9f4386-7528-40a4-9b44-826be10f5c21 not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:01:13.025466 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port e1d82060-6f66-481d-9c81-e9d5e1ed09f9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:13.036418 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'port_id': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'mac_address': 'fa:16:3e:f5:4b:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 414, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 06:01:13.073160 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:13.089923 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e1d82060-6f66-481d-9c81-e9d5e1ed09f9 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:01:13.109403 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port e1d82060-6f66-481d-9c81-e9d5e1ed09f9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:13.113583 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:13.121220 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-e0ee5752-0fdb-41ce-97a8-655fb56b6c8a admin admin] Deleting port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:01:13.121741 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e0ee5752-0fdb-41ce-97a8-655fb56b6c8a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:13.162862 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:13.169666 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:01:13.170014 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:01:13.170358 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:01:13.170695 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:01:13.171025 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:01:13.171353 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:01:13.171706 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:01:13.172035 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:01:13.172364 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:01:13.172688 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:01:13.173010 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:01:13.173326 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:01:13.173646 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:01:13.203968 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [None req-e0ee5752-0fdb-41ce-97a8-655fb56b6c8a admin admin] For port 43066bfd-26eb-4a35-9f53-02e9ff2e6c84, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=43066bfd-26eb-4a35-9f53-02e9ff2e6c84,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:13.204347 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e0ee5752-0fdb-41ce-97a8-655fb56b6c8a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:13.216235 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-e0ee5752-0fdb-41ce-97a8-655fb56b6c8a admin admin] Calling delete_port for 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 owned by network:router_interface {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:01:13.392902 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e0ee5752-0fdb-41ce-97a8-655fb56b6c8a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:13.412475 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['e1d82060-6f66-481d-9c81-e9d5e1ed09f9'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:01:13.417720 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ee5752-0fdb-41ce-97a8-655fb56b6c8a admin admin] Pushing event deleted for resources: {'Port': ['ID=43066bfd-26eb-4a35-9f53-02e9ff2e6c84,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:13.605137 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e0ee5752-0fdb-41ce-97a8-655fb56b6c8a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1617481', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1697260'] for router_interface, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:13.822528 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e0ee5752-0fdb-41ce-97a8-655fb56b6c8a admin admin] Router 728e739d-afec-42c9-b7f9-65837b18602c has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:01:13.961885 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e0ee5752-0fdb-41ce-97a8-655fb56b6c8a admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:01:13.969646 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-e0ee5752-0fdb-41ce-97a8-655fb56b6c8a admin admin] 10.222.0.46 "PUT /v2.0/routers/728e739d-afec-42c9-b7f9-65837b18602c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8417215 Dec 20 06:01:13.969973 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50212) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:13.972065 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-763898f3-2a1f-4bd3-88e7-0ed3ee0a2498 None None] Sync routers for ids ['728e739d-afec-42c9-b7f9-65837b18602c'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:01:13.981356 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a60f6b-5d65-43b7-bbdf-bc5ee96fcd6f req-b2ff0d31-77ea-417e-8653-7e067ec5560b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:13.982833 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c3a60f6b-5d65-43b7-bbdf-bc5ee96fcd6f req-b2ff0d31-77ea-417e-8653-7e067ec5560b tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 945 time: 0.0757577 Dec 20 06:01:13.996597 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-763898f3-2a1f-4bd3-88e7-0ed3ee0a2498 None None] Routers {'728e739d-afec-42c9-b7f9-65837b18602c'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:01:13.997478 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-763898f3-2a1f-4bd3-88e7-0ed3ee0a2498 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:01:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['728e739d-afec-42c9-b7f9-65837b18602c'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:14.051959 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c3a60f6b-5d65-43b7-bbdf-bc5ee96fcd6f req-9af9f056-120f-4271-80f7-20fe83cec9a1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0581195 Dec 20 06:01:14.085654 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] Publish callbacks [] for router, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.116693 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-763898f3-2a1f-4bd3-88e7-0ed3ee0a2498 None None] Set router 728e739d-afec-42c9-b7f9-65837b18602c gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:01:14.186042 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.238079 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] Deleting port 973d22fc-4c72-4242-98d2-520773fe8892 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:01:14.238305 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.292167 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-763898f3-2a1f-4bd3-88e7-0ed3ee0a2498 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28'}], 'enable_snat': True}, 'gw_port_id': '973d22fc-4c72-4242-98d2-520773fe8892', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T06:01:13Z', 'revision_number': 5, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port': {'id': '973d22fc-4c72-4242-98d2-520773fe8892', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:1e:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '728e739d-afec-42c9-b7f9-65837b18602c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.28', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T05:55:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:14.321431 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] For port 973d22fc-4c72-4242-98d2-520773fe8892, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=973d22fc-4c72-4242-98d2-520773fe8892,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:14.321826 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.322620 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-763898f3-2a1f-4bd3-88e7-0ed3ee0a2498 None None] Checking router: 728e739d-afec-42c9-b7f9-65837b18602c for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:01:14.331054 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-763898f3-2a1f-4bd3-88e7-0ed3ee0a2498 None None] Routers {'728e739d-afec-42c9-b7f9-65837b18602c'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:01:14.331696 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-763898f3-2a1f-4bd3-88e7-0ed3ee0a2498 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:01:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['728e739d-afec-42c9-b7f9-65837b18602c'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:14.336834 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] Calling delete_port for 973d22fc-4c72-4242-98d2-520773fe8892 owned by network:router_gateway {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:01:14.417532 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-763898f3-2a1f-4bd3-88e7-0ed3ee0a2498 None None] Set router 728e739d-afec-42c9-b7f9-65837b18602c gateway port host: None {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:01:14.468010 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-763898f3-2a1f-4bd3-88e7-0ed3ee0a2498 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T06:01:14Z', 'revision_number': 6, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port_host': None}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:14.497376 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-763898f3-2a1f-4bd3-88e7-0ed3ee0a2498 None None] The sync data for ids ['728e739d-afec-42c9-b7f9-65837b18602c'] in dv-cinder-822278-1-iscsi is: [{'id': '728e739d-afec-42c9-b7f9-65837b18602c', 'name': 'tempest-TestShelveInstance-1060998211-router', 'tenant_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:51Z', 'updated_at': '2021-12-20T06:01:14Z', 'revision_number': 6, 'project_id': 'a67a7ba727e54b1c9f6ca2d5ea21f272', 'gw_port_host': None}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:01:14.500750 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.529725 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] Pushing event deleted for resources: {'Port': ['ID=973d22fc-4c72-4242-98d2-520773fe8892,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:14.588619 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1703502'] for router_gateway, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.675864 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1698526', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25973'] for router, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.677937 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.720621 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1698533'] for router, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.721567 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 728e739d-afec-42c9-b7f9-65837b18602c {{(pid=102446) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 20 06:01:14.726839 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] Publish callbacks [] for router, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.728028 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-c63f154b-3830-488c-b3c9-ad1604d6cb14 admin admin] 10.222.0.46 "DELETE /v2.0/routers/728e739d-afec-42c9-b7f9-65837b18602c HTTP/1.1" status: 204 len: 168 time: 0.7569120 Dec 20 06:01:14.730506 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50218) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:14.776159 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_v2 [None req-e112ece6-1a36-4e94-acf8-472cfa269fd7 admin admin] Deleting subnet a2b892f1-223d-4384-8544-8bbbbe5c621b {{(pid=102446) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 06:01:14.779219 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e112ece6-1a36-4e94-acf8-472cfa269fd7 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.813569 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e112ece6-1a36-4e94-acf8-472cfa269fd7 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8976279'] for subnet, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.895427 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e112ece6-1a36-4e94-acf8-472cfa269fd7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.916367 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device e1d82060-6f66-481d-9c81-e9d5e1ed09f9 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 06:01:14.950543 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e112ece6-1a36-4e94-acf8-472cfa269fd7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9173344', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3270978'] for subnet, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.970839 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port e1d82060-6f66-481d-9c81-e9d5e1ed09f9 completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 06:01:14.974143 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e112ece6-1a36-4e94-acf8-472cfa269fd7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a2b892f1-223d-4384-8544-8bbbbe5c621b,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:14.975717 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port e1d82060-6f66-481d-9c81-e9d5e1ed09f9 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 06:01:14.976646 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.981757 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e112ece6-1a36-4e94-acf8-472cfa269fd7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:14.984992 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-e112ece6-1a36-4e94-acf8-472cfa269fd7 admin admin] 10.222.0.46 "DELETE /v2.0/subnets/a2b892f1-223d-4384-8544-8bbbbe5c621b HTTP/1.1" status: 204 len: 168 time: 0.2535667 Dec 20 06:01:14.987595 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50222) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:14.998428 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a628c67-dd0b-4ce0-a9b7-73f30736cc88 None None] Network 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 06:01:15.059196 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.117317 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Deleting port 9986f966-f215-4a93-bea7-4c19b71eb341 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:01:15.117667 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.145070 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.174023 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:01:15.175372 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b42d74e-643b-43ee-a89d-24ff4c74b710 req-8052e491-f909-430e-92bd-9d9d953d3d04 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:15.177142 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4682787a-1f25-4470-b70c-403c66527370" -d '{"events": [{"server_uuid": "accc1938-7113-4752-b1cb-e7b9b1c5b96f", "name": "network-vif-plugged", "status": "completed", "tag": "e1d82060-6f66-481d-9c81-e9d5e1ed09f9"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:01:15.183501 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5b42d74e-643b-43ee-a89d-24ff4c74b710 req-8052e491-f909-430e-92bd-9d9d953d3d04 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 945 time: 0.0660443 Dec 20 06:01:15.189684 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] For port 9986f966-f215-4a93-bea7-4c19b71eb341, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=9986f966-f215-4a93-bea7-4c19b71eb341,segment=NetworkSegment(e14b6241-3561-4b23-bd30-af836d346b40),segment_id=e14b6241-3561-4b23-bd30-af836d346b40)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:15.190154 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.202773 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port e1d82060-6f66-481d-9c81-e9d5e1ed09f9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:15.211848 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.217836 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Calling delete_port for 9986f966-f215-4a93-bea7-4c19b71eb341 owned by network:dhcp {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:01:15.242720 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-425df806-ba02-4c49-8049-27690dc302a9 None None] DHCP port deletion for 0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 request from dv-cinder-822278-1-iscsi {{(pid=102447) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 20 06:01:15.265791 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5b42d74e-643b-43ee-a89d-24ff4c74b710 req-5a576c84-3595-49bf-aa48-6b0a30993d96 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0805840 Dec 20 06:01:15.317596 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:15.330365 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.354082 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-425df806-ba02-4c49-8049-27690dc302a9 None None] Deleting port 9986f966-f215-4a93-bea7-4c19b71eb341 {{(pid=102447) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:01:15.354770 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-425df806-ba02-4c49-8049-27690dc302a9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.361789 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Pushing event deleted for resources: {'Port': ['ID=9986f966-f215-4a93-bea7-4c19b71eb341,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:15.363857 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] No DVR routers for this DVR port 9986f966-f215-4a93-bea7-4c19b71eb341 on host dv-cinder-822278-1-iscsi {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:01:15.432822 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:01:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-497bfd77-0422-4b37-9477-a987f5589bb2 x-openstack-request-id: req-497bfd77-0422-4b37-9477-a987f5589bb2 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:01:15.433118 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "accc1938-7113-4752-b1cb-e7b9b1c5b96f", "name": "network-vif-plugged", "status": "completed", "tag": "e1d82060-6f66-481d-9c81-e9d5e1ed09f9", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:01:15.433370 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-497bfd77-0422-4b37-9477-a987f5589bb2 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:01:15.433762 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'code': 200} Dec 20 06:01:15.437958 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-425df806-ba02-4c49-8049-27690dc302a9 None None] For port 9986f966-f215-4a93-bea7-4c19b71eb341, host dv-cinder-822278-1-iscsi, got binding levels [] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:15.438353 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-425df806-ba02-4c49-8049-27690dc302a9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.443248 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.452814 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-425df806-ba02-4c49-8049-27690dc302a9 None None] Calling delete_port for 9986f966-f215-4a93-bea7-4c19b71eb341 owned by network:dhcp {{(pid=102447) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:01:15.456130 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.ipam_backend_mixin [None req-425df806-ba02-4c49-8049-27690dc302a9 None None] Port 9986f966-f215-4a93-bea7-4c19b71eb341 was not found and therefore no delete operation was performed {{(pid=102447) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 20 06:01:15.457436 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-425df806-ba02-4c49-8049-27690dc302a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340'] for port, after_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.465554 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0dda46a2-d87a-46ca-89fc-3cf651bd2fc3']}} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:15.475919 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e14b6241-3561-4b23-bd30-af836d346b40') {'for_net_delete': True} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:15.476222 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e14b6241-3561-4b23-bd30-af836d346b40') {} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:15.486231 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-425df806-ba02-4c49-8049-27690dc302a9 None None] Pushing event deleted for resources: {'Port': ['ID=9986f966-f215-4a93-bea7-4c19b71eb341,revision_number=None']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:15.488185 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8976286'] for segment, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.489825 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-425df806-ba02-4c49-8049-27690dc302a9 None None] No DVR routers for this DVR port 9986f966-f215-4a93-bea7-4c19b71eb341 on host dv-cinder-822278-1-iscsi {{(pid=102447) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:01:15.512442 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.520162 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Releasing vlan 407 on physical network physnet1 to pool {{(pid=102446) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 06:01:15.521114 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9173254'] for segment, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: warnings.warn(msg) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: Traceback (most recent call last): Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: timer() Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: cb(*args, **kw) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: return func(*args, **kwargs) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: self._notify() Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: self.callback(batched_events) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: event.method(event) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: return f(self, *a, **k) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._get(url).json() Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: return self.request(url, 'GET', **kwargs) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 06:01:15.522396 dv-cinder-822278-1-iscsi neutron-server[102446]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 06:01:15.578039 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.594975 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:15.598358 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] 10.222.0.46 "DELETE /v2.0/networks/0dda46a2-d87a-46ca-89fc-3cf651bd2fc3 HTTP/1.1" status: 204 len: 168 time: 0.6098478 Dec 20 06:01:15.601359 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50228) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:15.611765 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-268b465c-c1b3-4f10-9359-e9c286911073 admin admin] Pushing event deleted for resources: {'Network': ['ID=0dda46a2-d87a-46ca-89fc-3cf651bd2fc3,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:15.653746 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d807168-31dc-4a17-9dd0-3dcff3e21847 req-cff53bf4-97da-459f-a923-0009babb1d75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:15.655278 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1d807168-31dc-4a17-9dd0-3dcff3e21847 req-cff53bf4-97da-459f-a923-0009babb1d75 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 1099 time: 0.0507534 Dec 20 06:01:15.702079 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1d807168-31dc-4a17-9dd0-3dcff3e21847 req-91cb32ae-8b1b-45d6-909a-c8260acfe2d8 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0376074 Dec 20 06:01:15.960285 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-236dc89b-8b9b-4ebf-9726-a033fac098c7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1697024'] for router_interface, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.029912 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50236) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:16.054012 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 973d22fc-4c72-4242-98d2-520773fe8892 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:01:16.074053 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 973d22fc-4c72-4242-98d2-520773fe8892 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:01:16.074630 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 973d22fc-4c72-4242-98d2-520773fe8892 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:01:16.075131 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:01:16.106261 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:01:16.106962 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 43066bfd-26eb-4a35-9f53-02e9ff2e6c84 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:01:16.107396 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 9986f966-f215-4a93-bea7-4c19b71eb341 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:01:16.126424 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 9986f966-f215-4a93-bea7-4c19b71eb341 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:01:16.126773 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 9986f966-f215-4a93-bea7-4c19b71eb341 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:01:16.152045 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cc0fce3e-09ad-4251-ad59-f13b402a96f3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.223499 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-236dc89b-8b9b-4ebf-9726-a033fac098c7 admin admin] Deleting port 7b9699de-1644-4440-8d8c-0bf685972943 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:01:16.224124 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-236dc89b-8b9b-4ebf-9726-a033fac098c7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.228954 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cc0fce3e-09ad-4251-ad59-f13b402a96f3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.233195 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cc0fce3e-09ad-4251-ad59-f13b402a96f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.270220 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc0fce3e-09ad-4251-ad59-f13b402a96f3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d01280af-96a8-4214-9e30-6bd6f6133b06,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:16.274530 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-cc0fce3e-09ad-4251-ad59-f13b402a96f3 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=b9b6cc76b9cb4158a06e7436fa4581a5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2436244 Dec 20 06:01:16.277742 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50240) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:16.307723 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-236dc89b-8b9b-4ebf-9726-a033fac098c7 admin admin] For port 7b9699de-1644-4440-8d8c-0bf685972943, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=7b9699de-1644-4440-8d8c-0bf685972943,segment=NetworkSegment(7b70b34f-119b-467b-94c2-17c9cbdbee98),segment_id=7b70b34f-119b-467b-94c2-17c9cbdbee98)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:16.308088 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-236dc89b-8b9b-4ebf-9726-a033fac098c7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.322091 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-236dc89b-8b9b-4ebf-9726-a033fac098c7 admin admin] Calling delete_port for 7b9699de-1644-4440-8d8c-0bf685972943 owned by network:router_interface {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:01:16.328121 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e553e6b7-fb81-4b44-833e-0706662b314d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.374727 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e553e6b7-fb81-4b44-833e-0706662b314d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.420825 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a233fddd-0d26-49f3-a6af-3844012d48c0 req-370cd3cb-8020-4150-be6a-e0ac37f50135 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:16.422330 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a233fddd-0d26-49f3-a6af-3844012d48c0 req-370cd3cb-8020-4150-be6a-e0ac37f50135 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0831313 Dec 20 06:01:16.454846 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e553e6b7-fb81-4b44-833e-0706662b314d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.457695 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e553e6b7-fb81-4b44-833e-0706662b314d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.461553 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-e553e6b7-fb81-4b44-833e-0706662b314d admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/d01280af-96a8-4214-9e30-6bd6f6133b06 HTTP/1.1" status: 204 len: 168 time: 0.1802897 Dec 20 06:01:16.480745 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e553e6b7-fb81-4b44-833e-0706662b314d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d01280af-96a8-4214-9e30-6bd6f6133b06,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:16.492163 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a233fddd-0d26-49f3-a6af-3844012d48c0 req-46013c11-c678-4085-abb0-178a8899c801 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0591466 Dec 20 06:01:16.521128 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-236dc89b-8b9b-4ebf-9726-a033fac098c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.550483 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-236dc89b-8b9b-4ebf-9726-a033fac098c7 admin admin] Pushing event deleted for resources: {'Port': ['ID=7b9699de-1644-4440-8d8c-0bf685972943,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:16.727678 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-236dc89b-8b9b-4ebf-9726-a033fac098c7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1617481', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1697260'] for router_interface, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.752991 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50248) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:16.766354 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4c67ef55-be08-4442-bbb2-d6563c8901a3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.851734 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4c67ef55-be08-4442-bbb2-d6563c8901a3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.855863 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4c67ef55-be08-4442-bbb2-d6563c8901a3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.893951 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c67ef55-be08-4442-bbb2-d6563c8901a3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5da257a8-2f08-4e83-98c6-e7cdec756b2e,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:16.902857 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-4c67ef55-be08-4442-bbb2-d6563c8901a3 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=bd045062ae324265bed52adc58f0a72e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1464100 Dec 20 06:01:16.903151 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50250) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:16.956665 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-07587048-b857-4b31-831a-79072689e573 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:16.962291 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-236dc89b-8b9b-4ebf-9726-a033fac098c7 admin admin] Router 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:01:16.978652 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-07587048-b857-4b31-831a-79072689e573 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:17.025229 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-07587048-b857-4b31-831a-79072689e573 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:17.028066 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-07587048-b857-4b31-831a-79072689e573 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:17.029250 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-07587048-b857-4b31-831a-79072689e573 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/5da257a8-2f08-4e83-98c6-e7cdec756b2e HTTP/1.1" status: 204 len: 168 time: 0.1250720 Dec 20 06:01:17.036853 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07587048-b857-4b31-831a-79072689e573 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5da257a8-2f08-4e83-98c6-e7cdec756b2e,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:17.077217 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-236dc89b-8b9b-4ebf-9726-a033fac098c7 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:01:17.086140 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-236dc89b-8b9b-4ebf-9726-a033fac098c7 admin admin] 10.222.0.46 "PUT /v2.0/routers/4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4802537 Dec 20 06:01:17.086140 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50254) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:17.089585 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a19fadfb-87bf-4687-9256-468dedb86bdc None None] Sync routers for ids ['4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:01:17.103949 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a19fadfb-87bf-4687-9256-468dedb86bdc None None] Routers {'4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:01:17.104316 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-a19fadfb-87bf-4687-9256-468dedb86bdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:01:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:17.191985 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] Publish callbacks [] for router, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:17.224206 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-a19fadfb-87bf-4687-9256-468dedb86bdc None None] Set router 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:01:17.318606 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:17.385924 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] Deleting port 296558c0-da9a-41e2-8d59-d859119282bb {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:01:17.386489 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:17.431602 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-a19fadfb-87bf-4687-9256-468dedb86bdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'name': 'tempest-TestShelveInstance-955066821-router', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.153'}], 'enable_snat': True}, 'gw_port_id': '296558c0-da9a-41e2-8d59-d859119282bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T06:01:16Z', 'revision_number': 5, 'project_id': 'd82dce4bc31c44f380b140b751dacc3c', 'gw_port': {'id': '296558c0-da9a-41e2-8d59-d859119282bb', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:24:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T05:56:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:17.458108 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a19fadfb-87bf-4687-9256-468dedb86bdc None None] Checking router: 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:01:17.466501 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a19fadfb-87bf-4687-9256-468dedb86bdc None None] Routers {'4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:01:17.467109 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-a19fadfb-87bf-4687-9256-468dedb86bdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:01:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:17.473369 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] For port 296558c0-da9a-41e2-8d59-d859119282bb, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=296558c0-da9a-41e2-8d59-d859119282bb,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:17.473752 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:17.488092 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] Calling delete_port for 296558c0-da9a-41e2-8d59-d859119282bb owned by network:router_gateway {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:01:17.677570 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18d20b61-0a1d-4feb-8000-f25659537924 req-220b3df0-4471-4c56-ab05-0ace4ae21f1c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:17.679828 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-18d20b61-0a1d-4feb-8000-f25659537924 req-220b3df0-4471-4c56-ab05-0ace4ae21f1c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0643644 Dec 20 06:01:17.698176 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-a19fadfb-87bf-4687-9256-468dedb86bdc None None] Set router 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb gateway port host: None {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:01:17.708815 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:17.750898 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-18d20b61-0a1d-4feb-8000-f25659537924 req-40a5e8d2-027c-4ece-8326-e3c461f3d2e1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0529323 Dec 20 06:01:17.766302 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-a19fadfb-87bf-4687-9256-468dedb86bdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'name': 'tempest-TestShelveInstance-955066821-router', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T06:01:17Z', 'revision_number': 6, 'project_id': 'd82dce4bc31c44f380b140b751dacc3c', 'gw_port_host': None}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:17.794483 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a19fadfb-87bf-4687-9256-468dedb86bdc None None] The sync data for ids ['4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb'] in dv-cinder-822278-1-iscsi is: [{'id': '4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb', 'name': 'tempest-TestShelveInstance-955066821-router', 'tenant_id': 'd82dce4bc31c44f380b140b751dacc3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:55:56Z', 'updated_at': '2021-12-20T06:01:17Z', 'revision_number': 6, 'project_id': 'd82dce4bc31c44f380b140b751dacc3c', 'gw_port_host': None}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:01:17.895064 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e535e8-c82a-4896-a94a-939333b75950 req-0d1b98fb-20ad-4cee-b6df-fe54f12d755f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:17.897212 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-13e535e8-c82a-4896-a94a-939333b75950 req-0d1b98fb-20ad-4cee-b6df-fe54f12d755f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0582492 Dec 20 06:01:17.905518 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50282) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:17.910249 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-86e257c6-5a8d-4f08-92de-7c976de4e1d6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Request body: {'floatingip': {'port_id': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:01:17.952292 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-86e257c6-5a8d-4f08-92de-7c976de4e1d6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for floatingip, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.075430 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] Pushing event deleted for resources: {'Port': ['ID=296558c0-da9a-41e2-8d59-d859119282bb,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:18.101493 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1703502'] for router_gateway, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.233686 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1698526', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25973'] for router, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.237722 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.301024 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1698533'] for router, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.301976 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb {{(pid=102446) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 20 06:01:18.308825 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] Publish callbacks [] for router, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.310154 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-352e14dd-3e48-4a5a-83dc-09d038fb35e0 admin admin] 10.222.0.46 "DELETE /v2.0/routers/4b3d3ebb-6ccc-4798-863c-0f4cd90e38eb HTTP/1.1" status: 204 len: 168 time: 1.2235975 Dec 20 06:01:18.315976 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50294) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:18.361348 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_v2 [None req-19b8b465-b08c-4a07-a592-b7cc6de2ede8 admin admin] Deleting subnet d3c4b4eb-e61a-4c53-8658-913dc8e3c2fe {{(pid=102446) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 06:01:18.365182 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-19b8b465-b08c-4a07-a592-b7cc6de2ede8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.408283 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-19b8b465-b08c-4a07-a592-b7cc6de2ede8 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8976279'] for subnet, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.485533 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-86e257c6-5a8d-4f08-92de-7c976de4e1d6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.490014 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-86e257c6-5a8d-4f08-92de-7c976de4e1d6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.521739 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-19b8b465-b08c-4a07-a592-b7cc6de2ede8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.575612 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-19b8b465-b08c-4a07-a592-b7cc6de2ede8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9173344', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3270978'] for subnet, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.601528 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19b8b465-b08c-4a07-a592-b7cc6de2ede8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d3c4b4eb-e61a-4c53-8658-913dc8e3c2fe,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:18.605228 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-19b8b465-b08c-4a07-a592-b7cc6de2ede8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.608555 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-19b8b465-b08c-4a07-a592-b7cc6de2ede8 admin admin] 10.222.0.46 "DELETE /v2.0/subnets/d3c4b4eb-e61a-4c53-8658-913dc8e3c2fe HTTP/1.1" status: 204 len: 168 time: 0.2913208 Dec 20 06:01:18.611023 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50300) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:18.614308 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 7b9699de-1644-4440-8d8c-0bf685972943 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:01:18.618692 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2008688-6e6f-423b-918d-e5488056e4f1 None None] Network 3527cc32-eb9d-47f1-86ed-ee56f32f9073 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 06:01:18.665811 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 7b9699de-1644-4440-8d8c-0bf685972943 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:01:18.666158 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 7b9699de-1644-4440-8d8c-0bf685972943 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:01:18.700138 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.761128 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Deleting port 4db19e9b-aab1-4e70-bdfc-44279e419cf3 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:01:18.761466 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.832464 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43e46a57-c92c-4058-93b0-a7067700dab5 None None] DHCP port deletion for 3527cc32-eb9d-47f1-86ed-ee56f32f9073 request from dv-cinder-822278-1-iscsi {{(pid=102447) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 20 06:01:18.844459 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] For port 4db19e9b-aab1-4e70-bdfc-44279e419cf3, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=4db19e9b-aab1-4e70-bdfc-44279e419cf3,segment=NetworkSegment(7b70b34f-119b-467b-94c2-17c9cbdbee98),segment_id=7b70b34f-119b-467b-94c2-17c9cbdbee98)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:18.844842 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.859076 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Calling delete_port for 4db19e9b-aab1-4e70-bdfc-44279e419cf3 owned by network:dhcp {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:01:18.870278 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.l3_db [None req-86e257c6-5a8d-4f08-92de-7c976de4e1d6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Floating IP bb196bd1-e4ff-493d-8d0c-b3ed5c68d84f associated. External IP: 172.27.3.109, port: e1d82060-6f66-481d-9c81-e9d5e1ed09f9. Dec 20 06:01:18.888355 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-43e46a57-c92c-4058-93b0-a7067700dab5 None None] Deleting port 4db19e9b-aab1-4e70-bdfc-44279e419cf3 {{(pid=102447) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:01:18.888918 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-43e46a57-c92c-4058-93b0-a7067700dab5 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.961348 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.971338 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:01:18.984769 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-43e46a57-c92c-4058-93b0-a7067700dab5 None None] For port 4db19e9b-aab1-4e70-bdfc-44279e419cf3, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=4db19e9b-aab1-4e70-bdfc-44279e419cf3,segment=NetworkSegment(7b70b34f-119b-467b-94c2-17c9cbdbee98),segment_id=7b70b34f-119b-467b-94c2-17c9cbdbee98)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:18.985484 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-43e46a57-c92c-4058-93b0-a7067700dab5 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:18.999915 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-43e46a57-c92c-4058-93b0-a7067700dab5 None None] Calling delete_port for 4db19e9b-aab1-4e70-bdfc-44279e419cf3 owned by network:dhcp {{(pid=102447) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:01:19.002371 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Pushing event deleted for resources: {'Port': ['ID=4db19e9b-aab1-4e70-bdfc-44279e419cf3,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:19.007987 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] No DVR routers for this DVR port 4db19e9b-aab1-4e70-bdfc-44279e419cf3 on host dv-cinder-822278-1-iscsi {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:01:19.090090 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-43e46a57-c92c-4058-93b0-a7067700dab5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340'] for port, after_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:19.102579 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:19.116183 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-86e257c6-5a8d-4f08-92de-7c976de4e1d6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Router c3741b68-c75b-409c-9c20-6d6808f6e838 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:01:19.121688 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43e46a57-c92c-4058-93b0-a7067700dab5 None None] Pushing event deleted for resources: {'Port': ['ID=4db19e9b-aab1-4e70-bdfc-44279e419cf3,revision_number=None']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:19.123737 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3527cc32-eb9d-47f1-86ed-ee56f32f9073']}} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:19.125706 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43e46a57-c92c-4058-93b0-a7067700dab5 None None] No DVR routers for this DVR port 4db19e9b-aab1-4e70-bdfc-44279e419cf3 on host dv-cinder-822278-1-iscsi {{(pid=102447) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:01:19.138197 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7b70b34f-119b-467b-94c2-17c9cbdbee98') {'for_net_delete': True} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:19.138385 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7b70b34f-119b-467b-94c2-17c9cbdbee98') {} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:19.148235 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8976286'] for segment, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:19.161389 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:19.167416 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Releasing vlan 402 on physical network physnet1 to pool {{(pid=102446) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 06:01:19.167843 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9173254'] for segment, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: Traceback (most recent call last): Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: timer() Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: cb(*args, **kw) Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: return func(*args, **kwargs) Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: self._notify() Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: self.callback(batched_events) Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: event.method(event) Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: return f(self, *a, **k) Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._get(url).json() Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: return self.request(url, 'GET', **kwargs) Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 06:01:19.169629 dv-cinder-822278-1-iscsi neutron-server[102446]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 06:01:19.230198 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:19.235818 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:19.239112 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] 10.222.0.46 "DELETE /v2.0/networks/3527cc32-eb9d-47f1-86ed-ee56f32f9073 HTTP/1.1" status: 204 len: 168 time: 0.6267953 Dec 20 06:01:19.250325 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-86e257c6-5a8d-4f08-92de-7c976de4e1d6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:01:19.253551 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7ac54d0-4dec-4ec4-b96c-a3c1b1e7c0f8 admin admin] Pushing event deleted for resources: {'Network': ['ID=3527cc32-eb9d-47f1-86ed-ee56f32f9073,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:19.260260 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30a949ec-8a8d-4125-b0e3-5744f1142dcc None None] Sync routers for ids ['c3741b68-c75b-409c-9c20-6d6808f6e838'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:01:19.261385 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-86e257c6-5a8d-4f08-92de-7c976de4e1d6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:19.270848 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30a949ec-8a8d-4125-b0e3-5744f1142dcc None None] Routers {'c3741b68-c75b-409c-9c20-6d6808f6e838'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:01:19.271912 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-30a949ec-8a8d-4125-b0e3-5744f1142dcc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:01:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['c3741b68-c75b-409c-9c20-6d6808f6e838'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:19.288410 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-86e257c6-5a8d-4f08-92de-7c976de4e1d6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "PUT /v2.0/floatingips/bb196bd1-e4ff-493d-8d0c-b3ed5c68d84f HTTP/1.1" status: 200 len: 992 time: 1.3817024 Dec 20 06:01:19.289027 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'tag': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:01:19.291736 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-607d0e3b-5e83-4422-b392-9d9cc727879e" -d '{"events": [{"name": "network-changed", "server_uuid": "accc1938-7113-4752-b1cb-e7b9b1c5b96f", "tag": "e1d82060-6f66-481d-9c81-e9d5e1ed09f9"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:01:19.331849 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 06:01:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5f26cf76-8571-4679-9fc6-b6634b22af87 x-openstack-request-id: req-5f26cf76-8571-4679-9fc6-b6634b22af87 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:01:19.332231 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "accc1938-7113-4752-b1cb-e7b9b1c5b96f", "tag": "e1d82060-6f66-481d-9c81-e9d5e1ed09f9", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:01:19.332552 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-5f26cf76-8571-4679-9fc6-b6634b22af87 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:01:19.333023 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'tag': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'status': 'completed', 'code': 200} Dec 20 06:01:19.427359 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-30a949ec-8a8d-4125-b0e3-5744f1142dcc None None] Set router c3741b68-c75b-409c-9c20-6d6808f6e838 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:01:19.431837 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-607d0e3b-5e83-4422-b392-9d9cc727879e req-bba6ce9d-331f-49f9-a913-fe83dcfcb4f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:19.433418 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-607d0e3b-5e83-4422-b392-9d9cc727879e req-bba6ce9d-331f-49f9-a913-fe83dcfcb4f8 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 1099 time: 0.0506485 Dec 20 06:01:19.458950 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50308) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:19.511099 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-09c57997-bc7b-429d-ae17-37383837cc83 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=a67a7ba727e54b1c9f6ca2d5ea21f272&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0503144 Dec 20 06:01:19.513545 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50312) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:19.536979 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-607d0e3b-5e83-4422-b392-9d9cc727879e req-d8c9b306-7918-484a-86f2-ce79569c514a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:19.539150 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-607d0e3b-5e83-4422-b392-9d9cc727879e req-d8c9b306-7918-484a-86f2-ce79569c514a service neutron] 10.222.0.54 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 917 time: 0.0978036 Dec 20 06:01:19.576335 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-af11e622-fc8e-432b-8abb-6c760e18e4fe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:19.605233 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-af11e622-fc8e-432b-8abb-6c760e18e4fe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:19.625418 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-607d0e3b-5e83-4422-b392-9d9cc727879e req-4e76c1ad-4c82-4f12-acfb-725e0517a183 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9 HTTP/1.1" status: 200 len: 1000 time: 0.0784554 Dec 20 06:01:19.669032 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-af11e622-fc8e-432b-8abb-6c760e18e4fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:19.672895 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-af11e622-fc8e-432b-8abb-6c760e18e4fe admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:19.676134 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-af11e622-fc8e-432b-8abb-6c760e18e4fe admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/9e8c049b-658c-4e33-ab52-8f9fa7f9b332 HTTP/1.1" status: 204 len: 168 time: 0.1593831 Dec 20 06:01:19.694741 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-607d0e3b-5e83-4422-b392-9d9cc727879e req-40f3feb9-2fad-482f-81e0-045577aad138 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:19.696262 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-607d0e3b-5e83-4422-b392-9d9cc727879e req-40f3feb9-2fad-482f-81e0-045577aad138 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4b218758-bd28-403f-ac97-d980db9b78c8 HTTP/1.1" status: 200 len: 855 time: 0.0635390 Dec 20 06:01:19.703354 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af11e622-fc8e-432b-8abb-6c760e18e4fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e8c049b-658c-4e33-ab52-8f9fa7f9b332,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:19.761773 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-607d0e3b-5e83-4422-b392-9d9cc727879e req-859a0285-30ac-43de-8a7d-056fcd81ce5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:19.763479 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-607d0e3b-5e83-4422-b392-9d9cc727879e req-859a0285-30ac-43de-8a7d-056fcd81ce5d service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6623d855-6648-40fd-8a49-9c323edbff11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0594387 Dec 20 06:01:19.800421 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-30a949ec-8a8d-4125-b0e3-5744f1142dcc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': 'bb196bd1-e4ff-493d-8d0c-b3ed5c68d84f', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'floating_ip_address': '172.27.3.109', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'port_id': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 623, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'mac_address': 'fa:16:3e:f5:4b:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:01:05Z', 'updated_at': '2021-12-20T06:01:18Z', 'revision_number': 1, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:17Z', 'revision_number': 5, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:19.833438 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30a949ec-8a8d-4125-b0e3-5744f1142dcc None None] Checking router: c3741b68-c75b-409c-9c20-6d6808f6e838 for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:01:19.843143 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30a949ec-8a8d-4125-b0e3-5744f1142dcc None None] Routers {'c3741b68-c75b-409c-9c20-6d6808f6e838'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:01:19.843783 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-30a949ec-8a8d-4125-b0e3-5744f1142dcc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:01:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['c3741b68-c75b-409c-9c20-6d6808f6e838'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:19.862917 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-607d0e3b-5e83-4422-b392-9d9cc727879e req-20167c77-f4cb-42aa-a21e-6be5fc11a581 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0917332 Dec 20 06:01:19.950848 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-30a949ec-8a8d-4125-b0e3-5744f1142dcc None None] Set router c3741b68-c75b-409c-9c20-6d6808f6e838 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:01:19.955326 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-607d0e3b-5e83-4422-b392-9d9cc727879e req-eadfc22a-be13-4866-b1ce-0efc36ca45e2 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850389 Dec 20 06:01:20.058935 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 296558c0-da9a-41e2-8d59-d859119282bb no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:01:20.068060 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50322) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:20.079839 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 296558c0-da9a-41e2-8d59-d859119282bb {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:01:20.080189 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 296558c0-da9a-41e2-8d59-d859119282bb not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:01:20.080615 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 4db19e9b-aab1-4e70-bdfc-44279e419cf3 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:01:20.100629 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 4db19e9b-aab1-4e70-bdfc-44279e419cf3 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:01:20.100985 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 4db19e9b-aab1-4e70-bdfc-44279e419cf3 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:01:20.108629 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-e488f8e0-54cb-40a3-8e1a-ef56538fb63a admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=d82dce4bc31c44f380b140b751dacc3c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0392632 Dec 20 06:01:20.111556 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50324) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:20.163035 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-472fe0c2-7eff-4834-b8a7-847cc809e52d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:20.187337 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-472fe0c2-7eff-4834-b8a7-847cc809e52d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:20.187674 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-30a949ec-8a8d-4125-b0e3-5744f1142dcc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': 'bb196bd1-e4ff-493d-8d0c-b3ed5c68d84f', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'floating_ip_address': '172.27.3.109', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'port_id': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 623, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'mac_address': 'fa:16:3e:f5:4b:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:01:05Z', 'updated_at': '2021-12-20T06:01:18Z', 'revision_number': 1, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:17Z', 'revision_number': 5, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:20.217831 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30a949ec-8a8d-4125-b0e3-5744f1142dcc None None] The sync data for ids ['c3741b68-c75b-409c-9c20-6d6808f6e838'] in dv-cinder-822278-1-iscsi is: [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': 'bb196bd1-e4ff-493d-8d0c-b3ed5c68d84f', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'floating_ip_address': '172.27.3.109', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'port_id': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 623, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'mac_address': 'fa:16:3e:f5:4b:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:01:05Z', 'updated_at': '2021-12-20T06:01:18Z', 'revision_number': 1, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:17Z', 'revision_number': 5, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:01:20.234580 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-472fe0c2-7eff-4834-b8a7-847cc809e52d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:20.237382 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-472fe0c2-7eff-4834-b8a7-847cc809e52d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:20.238582 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-472fe0c2-7eff-4834-b8a7-847cc809e52d admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/5b9affbd-02c9-4b14-b761-f8b943e36be9 HTTP/1.1" status: 204 len: 168 time: 0.1254318 Dec 20 06:01:20.249333 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-472fe0c2-7eff-4834-b8a7-847cc809e52d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5b9affbd-02c9-4b14-b761-f8b943e36be9,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:20.423204 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7912e51-fb32-4b0a-8959-c2847074f85d None None] New status for floating IP bb196bd1-e4ff-493d-8d0c-b3ed5c68d84f: ACTIVE {{(pid=102447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 06:01:26.337340 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50362) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:26.438905 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e8cbd53-c0e0-4d9c-98b0-fc5420066190 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:26.515854 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e8cbd53-c0e0-4d9c-98b0-fc5420066190 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:26.519256 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-8e8cbd53-c0e0-4d9c-98b0-fc5420066190 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:26.555289 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-8e8cbd53-c0e0-4d9c-98b0-fc5420066190 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=e45509ae1aad4d98902b80c8dfa66363&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2169249 Dec 20 06:01:26.557144 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e8cbd53-c0e0-4d9c-98b0-fc5420066190 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=08bff4dc-1a62-4abc-b4be-2ca985f697fc,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:26.558081 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50366) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:01:26.606378 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-410d1b46-ba45-43b0-b283-eebe86f27c7a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:26.627571 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-410d1b46-ba45-43b0-b283-eebe86f27c7a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:26.673407 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-410d1b46-ba45-43b0-b283-eebe86f27c7a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:26.676103 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-410d1b46-ba45-43b0-b283-eebe86f27c7a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:26.677236 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-410d1b46-ba45-43b0-b283-eebe86f27c7a admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/08bff4dc-1a62-4abc-b4be-2ca985f697fc HTTP/1.1" status: 204 len: 168 time: 0.1181765 Dec 20 06:01:26.685327 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-410d1b46-ba45-43b0-b283-eebe86f27c7a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08bff4dc-1a62-4abc-b4be-2ca985f697fc,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:31.715371 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-4d77852a-3cfd-48da-9e92-f0189a8b7478 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:34.157922 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-0c3b75ed-a951-412b-a588-585749b83b6f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:35.001777 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:36.492261 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:37.573774 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:38.727588 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:41.291046 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92bf0057-4677-4a18-8147-c55bed52b414 req-b0b00d19-9412-4496-84c9-509c74bb98fb tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:41.293419 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-92bf0057-4677-4a18-8147-c55bed52b414 req-b0b00d19-9412-4496-84c9-509c74bb98fb tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 945 time: 0.0519710 Dec 20 06:01:41.345532 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-92bf0057-4677-4a18-8147-c55bed52b414 req-fe5194e1-b712-44b0-9bd6-8dc5bb70024a tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460525 Dec 20 06:01:42.459359 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15cb2434-fc28-45c2-a808-03c2a1dac7d4 req-2a21d28f-d250-4ee6-b230-fa005ddf6a57 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:42.460827 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-15cb2434-fc28-45c2-a808-03c2a1dac7d4 req-2a21d28f-d250-4ee6-b230-fa005ddf6a57 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 945 time: 0.0480490 Dec 20 06:01:42.508417 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-15cb2434-fc28-45c2-a808-03c2a1dac7d4 req-cc9e7e94-40ce-42d7-93ae-2ef503c5c872 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417678 Dec 20 06:01:43.135321 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-f619230c-24e2-4273-8f24-1c3a1c283143 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:43.136872 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-f619230c-24e2-4273-8f24-1c3a1c283143 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 945 time: 0.0540016 Dec 20 06:01:43.228325 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Deleting port 97c584e6-8c84-4348-b953-c84fc7440d6b {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:01:43.228679 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:43.315252 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] For port 97c584e6-8c84-4348-b953-c84fc7440d6b, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=97c584e6-8c84-4348-b953-c84fc7440d6b,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:43.315660 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:43.325819 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-1d09ffcb-3933-424e-9b3b-1e94a28f4bae req-51c456b6-34f1-400c-b1f0-c4ade9c402d8 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0385377 Dec 20 06:01:43.428356 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d09ffcb-3933-424e-9b3b-1e94a28f4bae req-bdc15afc-9d96-4e87-93c9-582daa2d6a4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:43.429852 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-1d09ffcb-3933-424e-9b3b-1e94a28f4bae req-bdc15afc-9d96-4e87-93c9-582daa2d6a4a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 1099 time: 0.0425482 Dec 20 06:01:43.495464 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:43.496093 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:43.496214 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.l3_db [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Floating IP 558b2a25-bb66-4ad7-bc1f-d0f3e9911d3d disassociated. External IP: 172.27.3.172, port: 97c584e6-8c84-4348-b953-c84fc7440d6b. Dec 20 06:01:43.496482 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Calling delete_port for 97c584e6-8c84-4348-b953-c84fc7440d6b owned by compute:nova {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:01:43.534391 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d09ffcb-3933-424e-9b3b-1e94a28f4bae req-f138e598-670e-4521-a793-0d882aee6234 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:43.536206 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-1d09ffcb-3933-424e-9b3b-1e94a28f4bae req-f138e598-670e-4521-a793-0d882aee6234 service neutron] 10.222.0.54 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 917 time: 0.0880356 Dec 20 06:01:43.604885 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-1d09ffcb-3933-424e-9b3b-1e94a28f4bae req-f0c95018-46fe-4ee4-aaea-2e201be9ba55 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9 HTTP/1.1" status: 200 len: 1002 time: 0.0613992 Dec 20 06:01:43.655704 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:43.659167 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d09ffcb-3933-424e-9b3b-1e94a28f4bae req-0f8e08a4-118e-4b76-9d89-ebfbd34544f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:43.660678 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-1d09ffcb-3933-424e-9b3b-1e94a28f4bae req-0f8e08a4-118e-4b76-9d89-ebfbd34544f9 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4b218758-bd28-403f-ac97-d980db9b78c8 HTTP/1.1" status: 200 len: 855 time: 0.0479543 Dec 20 06:01:43.691065 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event deleted for resources: {'Port': ['ID=97c584e6-8c84-4348-b953-c84fc7440d6b,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:43.704070 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18c28d0d-266f-4397-ba1d-35ec2c52ec35 req-89dc5070-3deb-4090-941e-706d25d7f1e7 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:43.705631 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-18c28d0d-266f-4397-ba1d-35ec2c52ec35 req-89dc5070-3deb-4090-941e-706d25d7f1e7 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=1c6183c8-bf08-4503-9eaf-a8e2a241a7c0 HTTP/1.1" status: 200 len: 945 time: 0.1223631 Dec 20 06:01:43.716468 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d09ffcb-3933-424e-9b3b-1e94a28f4bae req-611de227-4e6e-4c89-b8a5-0a2a4c4adddd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:43.718016 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-1d09ffcb-3933-424e-9b3b-1e94a28f4bae req-611de227-4e6e-4c89-b8a5-0a2a4c4adddd service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6623d855-6648-40fd-8a49-9c323edbff11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0504711 Dec 20 06:01:43.810100 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-1d09ffcb-3933-424e-9b3b-1e94a28f4bae req-44832ae3-527f-47b7-85ac-92ee977b6264 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842347 Dec 20 06:01:43.830745 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-18c28d0d-266f-4397-ba1d-35ec2c52ec35 req-f9b57176-af19-48c0-b905-590a7f9c7908 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0894883 Dec 20 06:01:43.848706 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Router 8700450f-8a60-4f59-88d0-7c64696c2fae has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:01:43.905997 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-1d09ffcb-3933-424e-9b3b-1e94a28f4bae req-58087707-5510-47a7-b5b2-a78f59c5c91a service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0864313 Dec 20 06:01:43.956497 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:01:43.965743 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90d3c689-637b-417f-8e60-beca0fa41f70 None None] Sync routers for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:01:43.976603 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90d3c689-637b-417f-8e60-beca0fa41f70 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:01:43.977708 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-90d3c689-637b-417f-8e60-beca0fa41f70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:01:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:43.995670 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] No DVR routers for this DVR port 97c584e6-8c84-4348-b953-c84fc7440d6b on host hv-cinder-82227 {{(pid=102445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:01:43.998186 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:44.001559 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6e1f17bd-90fb-4aef-9704-45ddf1a58e7b req-1dc68d6a-d544-431a-a235-7578fc6dab4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "DELETE /v2.0/ports/97c584e6-8c84-4348-b953-c84fc7440d6b HTTP/1.1" status: 204 len: 173 time: 0.8575385 Dec 20 06:01:44.002009 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c6183c8-bf08-4503-9eaf-a8e2a241a7c0', 'name': 'network-vif-deleted', 'tag': '97c584e6-8c84-4348-b953-c84fc7440d6b'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:01:44.004415 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f752298a-adc1-49da-8dd8-0143d58c7fc4" -d '{"events": [{"server_uuid": "1c6183c8-bf08-4503-9eaf-a8e2a241a7c0", "name": "network-vif-deleted", "tag": "97c584e6-8c84-4348-b953-c84fc7440d6b"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:01:44.057401 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:01:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2c731b1b-29f1-4e76-aeb5-8cf4949ea093 x-openstack-request-id: req-2c731b1b-29f1-4e76-aeb5-8cf4949ea093 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:01:44.057700 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c6183c8-bf08-4503-9eaf-a8e2a241a7c0", "name": "network-vif-deleted", "tag": "97c584e6-8c84-4348-b953-c84fc7440d6b", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:01:44.057956 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-2c731b1b-29f1-4e76-aeb5-8cf4949ea093 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:01:44.058393 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c6183c8-bf08-4503-9eaf-a8e2a241a7c0', 'name': 'network-vif-deleted', 'tag': '97c584e6-8c84-4348-b953-c84fc7440d6b', 'status': 'completed', 'code': 200} Dec 20 06:01:44.085756 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-90d3c689-637b-417f-8e60-beca0fa41f70 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:01:44.284819 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-90d3c689-637b-417f-8e60-beca0fa41f70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:44.310775 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90d3c689-637b-417f-8e60-beca0fa41f70 None None] Checking router: 8700450f-8a60-4f59-88d0-7c64696c2fae for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:01:44.319608 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90d3c689-637b-417f-8e60-beca0fa41f70 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:01:44.320213 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-90d3c689-637b-417f-8e60-beca0fa41f70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:01:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:44.432684 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-90d3c689-637b-417f-8e60-beca0fa41f70 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:01:44.624927 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-90d3c689-637b-417f-8e60-beca0fa41f70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:01:44.654260 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90d3c689-637b-417f-8e60-beca0fa41f70 None None] The sync data for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi is: [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:01:44.878804 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba647e7d-61dd-40a8-be5c-2714634840d8 None None] New status for floating IP 558b2a25-bb66-4ad7-bc1f-d0f3e9911d3d: DOWN {{(pid=102447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 06:01:45.096031 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-ea6a34bc-f6d8-46c5-873e-198ba55bacc4 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-487768033&fields=id&tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb HTTP/1.1" status: 200 len: 267 time: 0.0442157 Dec 20 06:01:45.200536 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-6a17de09-3a32-44c0-83a8-4fa9851772d5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:45.201975 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-6a17de09-3a32-44c0-83a8-4fa9851772d5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 812 time: 0.0994961 Dec 20 06:01:45.216741 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-2d2f67bc-1922-4498-ac9b-591c551037bc tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/quotas/1aefc80d27d3426daae57e2b0a4cbbbb HTTP/1.1" status: 200 len: 375 time: 0.0089202 Dec 20 06:01:45.266121 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-5a83991c-26f9-4e9e-8760-48dcd7a741a8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0439043 Dec 20 06:01:45.360833 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-c5a7f2f8-13c4-4f39-a792-672285d9253e service neutron] 10.222.0.46 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838168 Dec 20 06:01:45.453330 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-e62c5563-3753-4d06-970e-76020450dd7f service neutron] 10.222.0.46 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861058 Dec 20 06:01:45.733474 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-43051bcb-bf68-46d5-b002-6e3b996dba9e req-69d7c738-60e4-4301-9cf9-b2fa205a761b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 210 time: 0.0265489 Dec 20 06:01:46.735696 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-c82ee064-9b3f-45d7-a92b-fa0e7d274439 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:46.736860 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-c82ee064-9b3f-45d7-a92b-fa0e7d274439 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 812 time: 0.1075234 Dec 20 06:01:46.837313 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-54fa1a1c-7c4a-485a-8e09-a7f5bd3b2203 req-d4486cac-ee5b-4a93-a378-4d2bd4bd8b60 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 210 time: 0.0371623 Dec 20 06:01:46.861092 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-7c76d423-98d0-4f3f-be27-07b229d183c3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb HTTP/1.1" status: 200 len: 379 time: 0.0802066 Dec 20 06:01:46.871210 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-2310c306-fb95-4c39-b356-076d6827c636 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Request body: {'port': {'device_id': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'admin_state_up': True, 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'security_groups': ['9e3980a1-6cf9-4277-a78d-dd743d8d3bde']}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:01:46.979259 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-2310c306-fb95-4c39-b356-076d6827c636 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Made reservation on behalf of 1aefc80d27d3426daae57e2b0a4cbbbb for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 06:01:46.982587 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-2310c306-fb95-4c39-b356-076d6827c636 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:47.088786 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 97c584e6-8c84-4348-b953-c84fc7440d6b no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:01:47.107809 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-2310c306-fb95-4c39-b356-076d6827c636 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Allocated IP 172.20.0.13 (ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6/41d28c9a-6c88-4c21-87ff-6f5f781d2b3e/9ac5d62d-b561-4355-9ddf-44f7ab993939) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 06:01:47.111823 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: 97c584e6-8c84-4348-b953-c84fc7440d6b {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:01:47.112174 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 97c584e6-8c84-4348-b953-c84fc7440d6b not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:01:47.245007 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-2310c306-fb95-4c39-b356-076d6827c636 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:47.280156 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-2310c306-fb95-4c39-b356-076d6827c636 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:47.332185 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-2310c306-fb95-4c39-b356-076d6827c636 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 06:01:47.335434 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-2310c306-fb95-4c39-b356-076d6827c636 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 06:01:47.337811 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-2310c306-fb95-4c39-b356-076d6827c636 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 06:01:47.372244 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2310c306-fb95-4c39-b356-076d6827c636 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'Port': ['ID=9ac5d62d-b561-4355-9ddf-44f7ab993939,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:47.403423 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-2310c306-fb95-4c39-b356-076d6827c636 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:47.404197 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-2310c306-fb95-4c39-b356-076d6827c636 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:47.423571 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-2310c306-fb95-4c39-b356-076d6827c636 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5557783 Dec 20 06:01:47.444380 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Request body: {'port': {'device_id': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:01:47.502039 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:47.566438 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-7a23b9dc-82ee-4e5b-b8ff-666a6426e4c7 None None] Provisioning complete for port 9ac5d62d-b561-4355-9ddf-44f7ab993939 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 06:01:47.566810 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-7a23b9dc-82ee-4e5b-b8ff-666a6426e4c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:47.601082 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-7a23b9dc-82ee-4e5b-b8ff-666a6426e4c7 None None] Port 9ac5d62d-b561-4355-9ddf-44f7ab993939 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 06:01:47.761169 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9ac5d62d-b561-4355-9ddf-44f7ab993939 {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:01:47.770438 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:47.783729 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Transition to ACTIVE for port object 9ac5d62d-b561-4355-9ddf-44f7ab993939 will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 06:01:47.790084 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:47.856172 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Pushing event updated for resources: {'Port': ['ID=9ac5d62d-b561-4355-9ddf-44f7ab993939,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:47.918142 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Attempting to bind port 9ac5d62d-b561-4355-9ddf-44f7ab993939 on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 06:01:47.918474 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Attempting to bind port 9ac5d62d-b561-4355-9ddf-44f7ab993939 by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 06:01:47.918800 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Attempting to bind port 9ac5d62d-b561-4355-9ddf-44f7ab993939 on network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 06:01:47.924378 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Port 9ac5d62d-b561-4355-9ddf-44f7ab993939 on network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 06:01:47.924698 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Attempting to bind port 9ac5d62d-b561-4355-9ddf-44f7ab993939 on network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 06:01:47.948147 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 6, 1, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 06:01:47.948483 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Checking segment: {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 06:01:47.948872 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Bound using segment: {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 06:01:47.949308 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Bound port: 9ac5d62d-b561-4355-9ddf-44f7ab993939, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 06:01:47.949661 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:47.997307 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b8b848a-505e-4d12-bbb2-f70542be2a16 req-7348c586-8c97-4116-b75f-223f6f076c60 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:47.998702 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0b8b848a-505e-4d12-bbb2-f70542be2a16 req-7348c586-8c97-4116-b75f-223f6f076c60 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 944 time: 0.0904388 Dec 20 06:01:48.056807 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] For port 9ac5d62d-b561-4355-9ddf-44f7ab993939, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 06:01:48.074027 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0b8b848a-505e-4d12-bbb2-f70542be2a16 req-8c745ca9-5bf6-4114-8b5c-b902ca1458b6 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0689118 Dec 20 06:01:48.075638 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] For port 9ac5d62d-b561-4355-9ddf-44f7ab993939, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9ac5d62d-b561-4355-9ddf-44f7ab993939,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 06:01:48.080610 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:48.117471 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:48.118351 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:48.119794 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] 10.222.0.54 "PUT /v2.0/ports/9ac5d62d-b561-4355-9ddf-44f7ab993939 HTTP/1.1" status: 200 len: 1094 time: 0.6797140 Dec 20 06:01:48.120251 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'tag': '9ac5d62d-b561-4355-9ddf-44f7ab993939'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:01:48.122499 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1b911985-88a8-4522-9d37-e05ebada889c" -d '{"events": [{"name": "network-changed", "server_uuid": "c1a7f178-881d-4b95-a506-791409e73d6b", "tag": "9ac5d62d-b561-4355-9ddf-44f7ab993939"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:01:48.155852 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d1bd0d1-05ab-4fca-9615-7cf17e9d7022 service neutron] Pushing event updated for resources: {'Port': ['ID=9ac5d62d-b561-4355-9ddf-44f7ab993939,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:48.179472 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 06:01:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d5e5da13-3a1c-494f-8ea5-5331f2c0bf35 x-openstack-request-id: req-d5e5da13-3a1c-494f-8ea5-5331f2c0bf35 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:01:48.179790 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c1a7f178-881d-4b95-a506-791409e73d6b", "tag": "9ac5d62d-b561-4355-9ddf-44f7ab993939", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:01:48.180048 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-d5e5da13-3a1c-494f-8ea5-5331f2c0bf35 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:01:48.180445 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'tag': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'status': 'completed', 'code': 200} Dec 20 06:01:48.251054 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-60b49f83-d987-4442-8176-ac5558777061 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:48.252638 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-60b49f83-d987-4442-8176-ac5558777061 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 1097 time: 0.0508144 Dec 20 06:01:48.321136 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-b3d3747e-254e-4182-81cf-b3cf65dd7e60 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9ac5d62d-b561-4355-9ddf-44f7ab993939 HTTP/1.1" status: 200 len: 217 time: 0.0355456 Dec 20 06:01:48.376825 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-023ab36d-c138-4778-9d63-d51f61224af0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:48.378208 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-023ab36d-c138-4778-9d63-d51f61224af0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e HTTP/1.1" status: 200 len: 851 time: 0.0437391 Dec 20 06:01:48.426808 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-015f0723-4240-4917-92e2-726dff6a70dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:48.428303 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-015f0723-4240-4917-92e2-726dff6a70dc service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0430107 Dec 20 06:01:48.519792 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-1d851322-a04f-433b-9581-9ed8c7c77713 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842745 Dec 20 06:01:48.610171 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bb886e7e-a1e5-4084-ad85-7c867e9f1188 req-92ececd2-c1c5-44b0-a30e-7373d29448df service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831652 Dec 20 06:01:48.763988 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b911985-88a8-4522-9d37-e05ebada889c req-ecfc898a-174a-47e3-a9ab-464c2abbcd2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:48.765450 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1b911985-88a8-4522-9d37-e05ebada889c req-ecfc898a-174a-47e3-a9ab-464c2abbcd2f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 1097 time: 0.0400362 Dec 20 06:01:48.857139 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b911985-88a8-4522-9d37-e05ebada889c req-5263b60c-5fd9-4878-9dcc-14813f7ddaae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:48.858573 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1b911985-88a8-4522-9d37-e05ebada889c req-5263b60c-5fd9-4878-9dcc-14813f7ddaae service neutron] 10.222.0.54 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 913 time: 0.0822296 Dec 20 06:01:48.904752 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1b911985-88a8-4522-9d37-e05ebada889c req-d86ab566-f45b-4273-a811-7e148cadc23b service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9ac5d62d-b561-4355-9ddf-44f7ab993939 HTTP/1.1" status: 200 len: 217 time: 0.0364792 Dec 20 06:01:48.953791 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b911985-88a8-4522-9d37-e05ebada889c req-239a9f71-7867-46ac-aa2a-96ba88a32c7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:48.955170 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1b911985-88a8-4522-9d37-e05ebada889c req-239a9f71-7867-46ac-aa2a-96ba88a32c7d service neutron] 10.222.0.54 "GET /v2.0/subnets?id=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e HTTP/1.1" status: 200 len: 851 time: 0.0415719 Dec 20 06:01:49.000939 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b911985-88a8-4522-9d37-e05ebada889c req-b106aa57-acc1-4fff-9aff-8085f9bc9a53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:49.002386 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1b911985-88a8-4522-9d37-e05ebada889c req-b106aa57-acc1-4fff-9aff-8085f9bc9a53 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0393705 Dec 20 06:01:49.095074 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1b911985-88a8-4522-9d37-e05ebada889c req-3e48d711-3704-4f3c-b207-0c6f674a07f5 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851569 Dec 20 06:01:49.213065 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1b911985-88a8-4522-9d37-e05ebada889c req-668a28d4-1304-42c3-afe1-bde16c36b44f service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1109190 Dec 20 06:01:49.223473 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf9aad1c-762c-4982-b3e6-de755f21e8b0 req-ea25d039-8ec6-43ce-bf4e-f9a75be86590 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:49.224872 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bf9aad1c-762c-4982-b3e6-de755f21e8b0 req-ea25d039-8ec6-43ce-bf4e-f9a75be86590 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 944 time: 0.0696020 Dec 20 06:01:49.272374 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-bf9aad1c-762c-4982-b3e6-de755f21e8b0 req-67514acc-910a-49a9-9ffb-aacb159f1a37 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417502 Dec 20 06:01:50.384206 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcda95a1-fcc8-4ab0-bb7e-30f7751610d5 req-8e0f6c8c-0e05-413e-afd3-8415c33b3145 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:50.385700 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dcda95a1-fcc8-4ab0-bb7e-30f7751610d5 req-8e0f6c8c-0e05-413e-afd3-8415c33b3145 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 944 time: 0.0482399 Dec 20 06:01:50.433812 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-dcda95a1-fcc8-4ab0-bb7e-30f7751610d5 req-a037929b-4647-4767-bc61-c4a5a59c427c tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421247 Dec 20 06:01:51.567056 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f00ac00e-3c1d-4a1a-aa90-d8847842a293 req-97ec04de-c626-40bc-9282-0314c50fb54f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:51.569286 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f00ac00e-3c1d-4a1a-aa90-d8847842a293 req-97ec04de-c626-40bc-9282-0314c50fb54f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 944 time: 0.0519238 Dec 20 06:01:51.617409 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f00ac00e-3c1d-4a1a-aa90-d8847842a293 req-09bb3db4-6545-4112-8e19-280861d40a0a tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424988 Dec 20 06:01:52.735586 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00de4abc-dd02-498a-b71f-8f1ff6ab7dd8 req-0c9deb70-1d0b-4c2e-8160-6ce950135846 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:52.737112 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-00de4abc-dd02-498a-b71f-8f1ff6ab7dd8 req-0c9deb70-1d0b-4c2e-8160-6ce950135846 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 944 time: 0.0529966 Dec 20 06:01:52.785691 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-00de4abc-dd02-498a-b71f-8f1ff6ab7dd8 req-60c55a92-4c2a-46ea-bc12-d2fd3e6c692d tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419343 Dec 20 06:01:53.897202 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e004072c-56a2-4539-977c-d987b7fec88f req-7e0f59ef-06ec-4c0c-a78b-1bf87020c7e8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:53.898648 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e004072c-56a2-4539-977c-d987b7fec88f req-7e0f59ef-06ec-4c0c-a78b-1bf87020c7e8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 944 time: 0.0462492 Dec 20 06:01:53.950186 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e004072c-56a2-4539-977c-d987b7fec88f req-5f4d0926-8670-48ba-b5de-d6e9f1d280b7 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450552 Dec 20 06:01:55.066628 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc1d52fb-94d6-42ab-b6b7-fe985dcc5ff4 req-cd52deea-2521-4470-9445-2b1752a807d9 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:55.068206 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cc1d52fb-94d6-42ab-b6b7-fe985dcc5ff4 req-cd52deea-2521-4470-9445-2b1752a807d9 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 944 time: 0.0484219 Dec 20 06:01:55.115636 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cc1d52fb-94d6-42ab-b6b7-fe985dcc5ff4 req-2b9e1e2d-9122-4913-93a0-8d80170c8300 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416703 Dec 20 06:01:55.969245 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:01:56.227148 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eaeb160-b1f0-4c38-a345-2d9de141b516 req-7c1d8c45-b411-48a9-9a9e-98eb98f8dd46 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:56.228598 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9eaeb160-b1f0-4c38-a345-2d9de141b516 req-7c1d8c45-b411-48a9-9a9e-98eb98f8dd46 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 944 time: 0.0478373 Dec 20 06:01:56.275168 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9eaeb160-b1f0-4c38-a345-2d9de141b516 req-c7590eb8-749a-4900-9b0d-1a31d8144566 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407908 Dec 20 06:01:57.134528 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 9ac5d62d-b561-4355-9ddf-44f7ab993939 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 06:01:57.229265 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 9ac5d62d-b561-4355-9ddf-44f7ab993939, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9ac5d62d-b561-4355-9ddf-44f7ab993939,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:57.241236 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'port_id': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'mac_address': 'fa:16:3e:37:2c:d6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 448, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 06:01:57.279633 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:57.292361 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9ac5d62d-b561-4355-9ddf-44f7ab993939 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:01:57.311678 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 9ac5d62d-b561-4355-9ddf-44f7ab993939, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9ac5d62d-b561-4355-9ddf-44f7ab993939,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:57.316382 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:57.365226 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=9ac5d62d-b561-4355-9ddf-44f7ab993939,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:57.391618 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed243b8-8e85-4fa9-a58a-5c2cb4af9dea req-954b3092-075e-46e2-ab5e-c8badcfc4d91 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:57.393047 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3ed243b8-8e85-4fa9-a58a-5c2cb4af9dea req-954b3092-075e-46e2-ab5e-c8badcfc4d91 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 945 time: 0.0511203 Dec 20 06:01:57.442930 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3ed243b8-8e85-4fa9-a58a-5c2cb4af9dea req-8e137f5b-8969-4e52-a71d-bbb58a5da1a6 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432858 Dec 20 06:01:57.601389 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['9ac5d62d-b561-4355-9ddf-44f7ab993939'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:01:58.568871 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5206f98c-b5f9-4a88-8002-622499e150fa req-2ebe0224-6db9-4c11-ad8c-177dcc9cc439 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:58.570383 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5206f98c-b5f9-4a88-8002-622499e150fa req-2ebe0224-6db9-4c11-ad8c-177dcc9cc439 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 945 time: 0.0529749 Dec 20 06:01:58.628097 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5206f98c-b5f9-4a88-8002-622499e150fa req-5e935090-7885-47f1-a6b1-446f8b69bbba tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0503469 Dec 20 06:01:59.166363 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 9ac5d62d-b561-4355-9ddf-44f7ab993939 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 06:01:59.213841 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port 9ac5d62d-b561-4355-9ddf-44f7ab993939 completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 06:01:59.217384 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 9ac5d62d-b561-4355-9ddf-44f7ab993939 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 06:01:59.217749 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:59.293954 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:59.315164 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9ac5d62d-b561-4355-9ddf-44f7ab993939'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:01:59.317378 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8e7515df-6447-4b4e-90cc-a906fee795b6" -d '{"events": [{"server_uuid": "c1a7f178-881d-4b95-a506-791409e73d6b", "name": "network-vif-plugged", "status": "completed", "tag": "9ac5d62d-b561-4355-9ddf-44f7ab993939"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:01:59.329863 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 9ac5d62d-b561-4355-9ddf-44f7ab993939, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9ac5d62d-b561-4355-9ddf-44f7ab993939,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:01:59.334076 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:01:59.356783 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:01:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3171a967-e154-4930-af99-f19e881f6289 x-openstack-request-id: req-3171a967-e154-4930-af99-f19e881f6289 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:01:59.357066 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c1a7f178-881d-4b95-a506-791409e73d6b", "name": "network-vif-plugged", "status": "completed", "tag": "9ac5d62d-b561-4355-9ddf-44f7ab993939", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:01:59.357314 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-3171a967-e154-4930-af99-f19e881f6289 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:01:59.357693 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'code': 200} Dec 20 06:01:59.381859 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=9ac5d62d-b561-4355-9ddf-44f7ab993939,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:01:59.601216 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827ad280-aa7f-4a85-8a64-3a35f4e9b3e6 req-99e490de-1155-45c4-ba10-b648a6c5c8c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:59.603325 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-827ad280-aa7f-4a85-8a64-3a35f4e9b3e6 req-99e490de-1155-45c4-ba10-b648a6c5c8c1 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 1099 time: 0.0430553 Dec 20 06:01:59.649118 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-827ad280-aa7f-4a85-8a64-3a35f4e9b3e6 req-eefe4af5-76da-4c95-9011-315b8e17e2b9 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0386472 Dec 20 06:01:59.740957 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00a9c5f8-b6f2-42b1-b963-fff9994e630f req-df28fe61-e3b8-48e7-a5f7-5318cd3c513b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:01:59.742422 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-00a9c5f8-b6f2-42b1-b963-fff9994e630f req-df28fe61-e3b8-48e7-a5f7-5318cd3c513b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 946 time: 0.0530500 Dec 20 06:01:59.790413 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-00a9c5f8-b6f2-42b1-b963-fff9994e630f req-94e07bb2-4be8-4ad3-81cd-4d5ae8dc9ee2 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420930 Dec 20 06:02:01.146533 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6793e18-5492-45b1-995c-96cc6807e65b req-f00ecdc7-f863-4f21-8fac-527bc86d2f45 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:01.148009 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a6793e18-5492-45b1-995c-96cc6807e65b req-f00ecdc7-f863-4f21-8fac-527bc86d2f45 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.3069315 Dec 20 06:02:01.158427 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-837d7633-493f-46d8-bc0a-e85fc3185321 req-ac71821f-255b-44b6-8409-4b99fd354d1b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:01.159790 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-837d7633-493f-46d8-bc0a-e85fc3185321 req-ac71821f-255b-44b6-8409-4b99fd354d1b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 946 time: 0.2934649 Dec 20 06:02:01.222299 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a6793e18-5492-45b1-995c-96cc6807e65b req-5994f09b-768a-4db5-a3a9-ec215a5c252a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0616043 Dec 20 06:02:01.235565 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-837d7633-493f-46d8-bc0a-e85fc3185321 req-c2115083-d152-44cd-a3a3-0ee53b2ad2e2 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0687680 Dec 20 06:02:01.345784 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0860966a-9ab0-4d53-ad8f-f202df849b8c req-d4b38e1a-0558-4159-b9d0-067675141454 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:01.347255 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0860966a-9ab0-4d53-ad8f-f202df849b8c req-d4b38e1a-0558-4159-b9d0-067675141454 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 946 time: 0.0479686 Dec 20 06:02:01.396595 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0860966a-9ab0-4d53-ad8f-f202df849b8c req-a41814c2-ff9b-47cb-8a96-9a2822c968b8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421076 Dec 20 06:02:01.418435 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50520) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:02:01.459386 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77a4852d-d92d-46d7-b8e5-238b46f2ee4a tempest-TestVolumeBootPattern-384334718 tempest-TestVolumeBootPattern-384334718-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:01.460868 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-77a4852d-d92d-46d7-b8e5-238b46f2ee4a tempest-TestVolumeBootPattern-384334718 tempest-TestVolumeBootPattern-384334718-project-admin] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 1094 time: 0.0414577 Dec 20 06:02:01.463676 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50522) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:02:01.467747 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Request body: {'floatingip': {'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'port_id': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address': '172.20.0.13'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:02:01.490058 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for floatingip, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:01.579011 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:01.684745 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Allocated IP 172.27.3.129 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/d046e9ce-ddb2-463a-bbce-8adf3550c59c) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 06:02:01.716941 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-87a1a3d2-0438-420c-ae52-c7b7c603589f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:01.781950 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:01.818502 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:01.850844 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 06:02:01.856896 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 06:02:01.860283 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 06:02:01.883110 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'Port': ['ID=d046e9ce-ddb2-463a-bbce-8adf3550c59c,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:02:01.895745 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:01.896119 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:01.896459 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:01.896788 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:01.897115 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:01.897438 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:01.897762 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:01.898081 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:01.898399 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:01.898716 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:01.899034 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:01.899348 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:01.899682 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:02.220745 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:02.284887 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:02.387593 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d35debd9-e0eb-4f10-ac24-997be01ee23b req-789a843b-4ea0-4830-80b0-3a021d1e3715 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:02.389067 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d35debd9-e0eb-4f10-ac24-997be01ee23b req-789a843b-4ea0-4830-80b0-3a021d1e3715 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0840487 Dec 20 06:02:02.483048 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d35debd9-e0eb-4f10-ac24-997be01ee23b req-aee3403c-76b1-4671-b9c4-275872812781 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0654223 Dec 20 06:02:02.505169 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:02.509778 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:02.577331 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'Port': ['ID=d046e9ce-ddb2-463a-bbce-8adf3550c59c,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:02:02.588859 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:02.685818 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.l3_db [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Floating IP 8084dafe-347a-4114-b271-db1f87312b55 associated. External IP: 172.27.3.129, port: 9ac5d62d-b561-4355-9ddf-44f7ab993939. Dec 20 06:02:02.886355 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Router 8700450f-8a60-4f59-88d0-7c64696c2fae has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:02:02.987819 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:02:02.997343 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9f885b3-e93c-4c6f-bdcd-24c2e371d0af None None] Sync routers for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:02:03.004825 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:03.007821 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9f885b3-e93c-4c6f-bdcd-24c2e371d0af None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:02:03.008423 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-f9f885b3-e93c-4c6f-bdcd-24c2e371d0af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:01:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:02:03.034548 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-a440a399-76c5-47a1-a84a-abeb8289de44 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.5698898 Dec 20 06:02:03.035125 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'tag': '9ac5d62d-b561-4355-9ddf-44f7ab993939'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:02:03.037426 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1557f6d7-2926-4b47-b5ad-a5d271a88989" -d '{"events": [{"name": "network-changed", "server_uuid": "c1a7f178-881d-4b95-a506-791409e73d6b", "tag": "9ac5d62d-b561-4355-9ddf-44f7ab993939"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:02:03.074444 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 06:02:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0ae0209-5b75-40c2-a2a9-a71220611b43 x-openstack-request-id: req-e0ae0209-5b75-40c2-a2a9-a71220611b43 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:02:03.074740 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c1a7f178-881d-4b95-a506-791409e73d6b", "tag": "9ac5d62d-b561-4355-9ddf-44f7ab993939", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:02:03.075000 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-e0ae0209-5b75-40c2-a2a9-a71220611b43 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:02:03.075405 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'tag': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'status': 'completed', 'code': 200} Dec 20 06:02:03.177443 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1557f6d7-2926-4b47-b5ad-a5d271a88989 req-89ce0811-d0cf-4e62-8a2b-66c92d240875 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:03.179015 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1557f6d7-2926-4b47-b5ad-a5d271a88989 req-89ce0811-d0cf-4e62-8a2b-66c92d240875 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 1099 time: 0.0508025 Dec 20 06:02:03.229072 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-f9f885b3-e93c-4c6f-bdcd-24c2e371d0af None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:02:03.270762 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1557f6d7-2926-4b47-b5ad-a5d271a88989 req-8cf5d664-0f20-47b4-951b-8566e02f4613 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:03.272867 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1557f6d7-2926-4b47-b5ad-a5d271a88989 req-8cf5d664-0f20-47b4-951b-8566e02f4613 service neutron] 10.222.0.54 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 913 time: 0.0852230 Dec 20 06:02:03.342379 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1557f6d7-2926-4b47-b5ad-a5d271a88989 req-d2af53aa-d489-45e6-8ceb-07be73c03c2d service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9ac5d62d-b561-4355-9ddf-44f7ab993939 HTTP/1.1" status: 200 len: 1000 time: 0.0625072 Dec 20 06:02:03.391229 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1557f6d7-2926-4b47-b5ad-a5d271a88989 req-e2b477c6-8127-4ae6-88af-1ca8dd98f15e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:03.392523 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1557f6d7-2926-4b47-b5ad-a5d271a88989 req-e2b477c6-8127-4ae6-88af-1ca8dd98f15e service neutron] 10.222.0.54 "GET /v2.0/subnets?id=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e HTTP/1.1" status: 200 len: 851 time: 0.0432005 Dec 20 06:02:03.437105 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1557f6d7-2926-4b47-b5ad-a5d271a88989 req-3ac0d6b2-e283-4631-b99d-2082546ff55c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:03.438518 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1557f6d7-2926-4b47-b5ad-a5d271a88989 req-3ac0d6b2-e283-4631-b99d-2082546ff55c service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0394018 Dec 20 06:02:03.449327 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-f9f885b3-e93c-4c6f-bdcd-24c2e371d0af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '8084dafe-347a-4114-b271-db1f87312b55', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.129', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 642, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:37:2c:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:02:02Z', 'updated_at': '2021-12-20T06:02:02Z', 'revision_number': 0, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:02:03.478217 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9f885b3-e93c-4c6f-bdcd-24c2e371d0af None None] Checking router: 8700450f-8a60-4f59-88d0-7c64696c2fae for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:02:03.486482 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9f885b3-e93c-4c6f-bdcd-24c2e371d0af None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:02:03.487084 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-f9f885b3-e93c-4c6f-bdcd-24c2e371d0af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:01:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:02:03.537473 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1557f6d7-2926-4b47-b5ad-a5d271a88989 req-9fac5f0a-0d7a-4db6-91e8-12ef219db253 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0900342 Dec 20 06:02:03.606903 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-f9f885b3-e93c-4c6f-bdcd-24c2e371d0af None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:02:03.662885 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b639c9e-e1d3-4b80-8f08-c11c2de371e2 req-5af95d4a-338d-4163-9992-938a56b4d6b0 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:03.664624 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3b639c9e-e1d3-4b80-8f08-c11c2de371e2 req-5af95d4a-338d-4163-9992-938a56b4d6b0 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.1031182 Dec 20 06:02:03.675926 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1557f6d7-2926-4b47-b5ad-a5d271a88989 req-b602929b-ff98-463f-8780-43b51d6cd0e6 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1323225 Dec 20 06:02:03.717936 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3b639c9e-e1d3-4b80-8f08-c11c2de371e2 req-561e1e7e-bb74-4d11-9138-46980dcf8583 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447621 Dec 20 06:02:03.838716 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-f9f885b3-e93c-4c6f-bdcd-24c2e371d0af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '8084dafe-347a-4114-b271-db1f87312b55', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.129', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 642, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:37:2c:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:02:02Z', 'updated_at': '2021-12-20T06:02:02Z', 'revision_number': 0, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:02:03.868429 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9f885b3-e93c-4c6f-bdcd-24c2e371d0af None None] The sync data for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi is: [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '8084dafe-347a-4114-b271-db1f87312b55', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.129', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 642, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:37:2c:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:02:02Z', 'updated_at': '2021-12-20T06:02:02Z', 'revision_number': 0, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:02:04.054964 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f308fe21-2646-438f-b851-dd64e43f82a5 None None] New status for floating IP 8084dafe-347a-4114-b271-db1f87312b55: ACTIVE {{(pid=102447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 06:02:04.179606 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-66cb49e0-31aa-4948-9d77-b32315352a83 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:04.839203 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-834025ed-709c-4262-9651-5280df572bd4 req-4cf207ce-a2dc-418b-ae61-f5b4d1b23fd8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:04.840708 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-834025ed-709c-4262-9651-5280df572bd4 req-4cf207ce-a2dc-418b-ae61-f5b4d1b23fd8 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0482996 Dec 20 06:02:04.886689 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-834025ed-709c-4262-9651-5280df572bd4 req-227eaca9-b7cd-4a05-aba3-8b46d387d4fd tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401902 Dec 20 06:02:05.000453 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:06.008214 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-452d3fea-b441-4474-a80c-14f8eb525357 req-2b7740ca-c00a-497c-8ab2-adb7bdd318bd tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:06.009716 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-452d3fea-b441-4474-a80c-14f8eb525357 req-2b7740ca-c00a-497c-8ab2-adb7bdd318bd tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0518017 Dec 20 06:02:06.055285 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-452d3fea-b441-4474-a80c-14f8eb525357 req-e52aaed1-5f22-4294-8a04-5cada53c4d01 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395768 Dec 20 06:02:06.494349 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:07.172012 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f68307c5-9c4d-4cc5-8391-af7dc01f8b01 req-333895cb-456f-4101-a2ca-c1db6f2bb799 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:07.173478 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f68307c5-9c4d-4cc5-8391-af7dc01f8b01 req-333895cb-456f-4101-a2ca-c1db6f2bb799 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0479383 Dec 20 06:02:07.219044 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f68307c5-9c4d-4cc5-8391-af7dc01f8b01 req-665a804c-e309-4f8a-9b85-d739a69c2004 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398061 Dec 20 06:02:07.575135 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:08.345194 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856fe5e8-e69f-44c4-823c-8ff66ac0b662 req-8b37c340-837e-401a-808c-cf56ff97edd3 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:08.346663 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-856fe5e8-e69f-44c4-823c-8ff66ac0b662 req-8b37c340-837e-401a-808c-cf56ff97edd3 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0517375 Dec 20 06:02:08.393857 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-856fe5e8-e69f-44c4-823c-8ff66ac0b662 req-2f7288f3-f989-459f-b061-4f40d0972637 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407238 Dec 20 06:02:08.738295 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:09.508937 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7014b4a-911a-4f61-8055-6bf01b9c0188 req-dc8f97a5-b3ad-462f-9c27-9569de0bb163 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:09.510404 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c7014b4a-911a-4f61-8055-6bf01b9c0188 req-dc8f97a5-b3ad-462f-9c27-9569de0bb163 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0467296 Dec 20 06:02:09.555368 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c7014b4a-911a-4f61-8055-6bf01b9c0188 req-843ef9ff-1362-4606-9d40-5e091361794d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392725 Dec 20 06:02:10.672456 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e143b2f-af5c-4c8a-af2d-297ae408a120 req-ed528905-2b37-448f-bce3-6e06789386a5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:10.673823 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2e143b2f-af5c-4c8a-af2d-297ae408a120 req-ed528905-2b37-448f-bce3-6e06789386a5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0487220 Dec 20 06:02:10.723085 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2e143b2f-af5c-4c8a-af2d-297ae408a120 req-7f7888fa-2e9e-48e3-89aa-b859677a352c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430882 Dec 20 06:02:11.838636 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d625c8-3332-4953-b088-420845f16b02 req-e1be3d28-e920-4452-b4fd-fb5a2e531e6c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:11.840117 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-99d625c8-3332-4953-b088-420845f16b02 req-e1be3d28-e920-4452-b4fd-fb5a2e531e6c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0469224 Dec 20 06:02:11.885408 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-99d625c8-3332-4953-b088-420845f16b02 req-33bb0800-6a62-485e-8dbc-58343d0dfca4 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395191 Dec 20 06:02:13.002641 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-513382d9-b7d4-46bd-8ad8-5ce3fce1020e req-b7fab3e4-d901-43b7-a105-c287c5ce3fea tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:13.004151 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-513382d9-b7d4-46bd-8ad8-5ce3fce1020e req-b7fab3e4-d901-43b7-a105-c287c5ce3fea tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0479910 Dec 20 06:02:13.050953 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-513382d9-b7d4-46bd-8ad8-5ce3fce1020e req-8907fc6a-07e2-49d8-a25c-2984206d39f1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407231 Dec 20 06:02:13.244513 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device e1d82060-6f66-481d-9c81-e9d5e1ed09f9 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 06:02:13.342732 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port e1d82060-6f66-481d-9c81-e9d5e1ed09f9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:02:13.354323 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'port_id': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'mac_address': 'fa:16:3e:f5:4b:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 414, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 06:02:13.394093 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:13.407397 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id e1d82060-6f66-481d-9c81-e9d5e1ed09f9 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:02:13.427896 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port e1d82060-6f66-481d-9c81-e9d5e1ed09f9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:02:13.431884 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:13.478787 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,revision_number=6']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:02:13.485401 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:13.485806 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:13.486141 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:13.486472 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:13.486822 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:13.487147 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:13.487466 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:13.487970 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:13.488156 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:13.488423 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:13.488740 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:13.489113 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:13.489943 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:02:13.597796 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['e1d82060-6f66-481d-9c81-e9d5e1ed09f9'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:02:14.190896 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ca39184-550c-4af5-9c10-b3453585e3aa req-04c34c8e-4806-4b34-a443-08957761ab19 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:14.196089 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7ca39184-550c-4af5-9c10-b3453585e3aa req-04c34c8e-4806-4b34-a443-08957761ab19 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 945 time: 0.0637424 Dec 20 06:02:14.261621 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7ca39184-550c-4af5-9c10-b3453585e3aa req-78e3e25b-4012-43b8-ae6a-80cd06d4e95f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0621285 Dec 20 06:02:15.248227 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device e1d82060-6f66-481d-9c81-e9d5e1ed09f9 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 06:02:15.300256 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port e1d82060-6f66-481d-9c81-e9d5e1ed09f9 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 06:02:15.300621 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:15.397415 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:15.401551 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdaacb90-1329-4abf-8d8b-60dd33a43319 req-2e48fa04-a15b-4d1b-9f56-814ba422c275 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:15.409787 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cdaacb90-1329-4abf-8d8b-60dd33a43319 req-2e48fa04-a15b-4d1b-9f56-814ba422c275 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 945 time: 0.0581510 Dec 20 06:02:15.426656 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:02:15.429098 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b39ae2a1-efb0-4eaa-aab2-31919cfe5295" -d '{"events": [{"server_uuid": "accc1938-7113-4752-b1cb-e7b9b1c5b96f", "name": "network-vif-plugged", "status": "completed", "tag": "e1d82060-6f66-481d-9c81-e9d5e1ed09f9"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:02:15.472704 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cdaacb90-1329-4abf-8d8b-60dd33a43319 req-50d4936c-36c0-4366-a8a0-08ac0bc453f1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0610547 Dec 20 06:02:15.599916 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:02:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7c3c4669-b720-481e-8f38-87301a6629cc x-openstack-request-id: req-7c3c4669-b720-481e-8f38-87301a6629cc {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:02:15.600149 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "accc1938-7113-4752-b1cb-e7b9b1c5b96f", "name": "network-vif-plugged", "status": "completed", "tag": "e1d82060-6f66-481d-9c81-e9d5e1ed09f9", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:02:15.600365 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-7c3c4669-b720-481e-8f38-87301a6629cc {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:02:15.600759 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'code': 200} Dec 20 06:02:15.602445 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port e1d82060-6f66-481d-9c81-e9d5e1ed09f9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:02:15.607450 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:15.656077 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,revision_number=7']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:02:16.625232 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37b45202-dd5e-4085-89f4-af992a0b0b46 req-3f705272-6029-49ee-9ea7-420284ff77e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:16.633114 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37b45202-dd5e-4085-89f4-af992a0b0b46 req-3f705272-6029-49ee-9ea7-420284ff77e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0691049 Dec 20 06:02:16.689379 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37b45202-dd5e-4085-89f4-af992a0b0b46 req-8d1a16b1-d03d-44f8-8718-1514b6abe3c9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480285 Dec 20 06:02:17.810413 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-783eef60-ccba-46bd-ab71-3392cd728bf8 req-11c9483f-010d-4d22-ac3b-14778649c804 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:17.812501 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-783eef60-ccba-46bd-ab71-3392cd728bf8 req-11c9483f-010d-4d22-ac3b-14778649c804 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0545540 Dec 20 06:02:17.868092 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-783eef60-ccba-46bd-ab71-3392cd728bf8 req-ed618ae5-9906-4ab5-a386-e4455445c869 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0481377 Dec 20 06:02:18.993556 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cf7bdf0-5bf4-44de-aacd-b9f7de12253a req-e3ce9f34-52a9-410d-8611-40eba6d4f5b4 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:19.001777 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0cf7bdf0-5bf4-44de-aacd-b9f7de12253a req-e3ce9f34-52a9-410d-8611-40eba6d4f5b4 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0636125 Dec 20 06:02:19.052221 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0cf7bdf0-5bf4-44de-aacd-b9f7de12253a req-7f2734cc-6183-41b0-9e76-b5e457535765 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478101 Dec 20 06:02:20.177399 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a178de6c-617c-4dbf-8087-c9ad080249de req-017db8c6-ffa9-48da-9268-17fb54021942 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:20.179072 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a178de6c-617c-4dbf-8087-c9ad080249de req-017db8c6-ffa9-48da-9268-17fb54021942 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0584278 Dec 20 06:02:20.231332 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a178de6c-617c-4dbf-8087-c9ad080249de req-0114a8d7-798c-4a62-8599-47c4b840f5f1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462036 Dec 20 06:02:21.357366 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b24f938-0b8a-48c4-877c-eefa1e982353 req-4e805cdc-ac8c-490b-83bf-ddec48e78b90 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:21.359038 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3b24f938-0b8a-48c4-877c-eefa1e982353 req-4e805cdc-ac8c-490b-83bf-ddec48e78b90 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0522082 Dec 20 06:02:21.416556 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3b24f938-0b8a-48c4-877c-eefa1e982353 req-1dae10d8-21cb-421a-989c-1fd472c11147 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0506854 Dec 20 06:02:22.538740 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4559476-7e0e-471e-a333-71e892645a47 req-8066707f-1a6b-45ea-a449-e01e6cab5a1e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:22.540216 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c4559476-7e0e-471e-a333-71e892645a47 req-8066707f-1a6b-45ea-a449-e01e6cab5a1e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0497983 Dec 20 06:02:22.585204 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c4559476-7e0e-471e-a333-71e892645a47 req-487a35e6-731d-465e-9048-88274b57696d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391419 Dec 20 06:02:23.198332 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b8e697-1690-418b-9a01-8324535f1d9a req-d0c5ae61-6d8e-4f13-91a4-b7ddf4619fe2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:23.199849 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-50b8e697-1690-418b-9a01-8324535f1d9a req-d0c5ae61-6d8e-4f13-91a4-b7ddf4619fe2 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 1099 time: 0.0413718 Dec 20 06:02:23.292846 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b8e697-1690-418b-9a01-8324535f1d9a req-b5ea803f-7c60-4e49-a28d-ca0acd5b0132 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:23.294303 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-50b8e697-1690-418b-9a01-8324535f1d9a req-b5ea803f-7c60-4e49-a28d-ca0acd5b0132 service neutron] 10.222.0.54 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 917 time: 0.0855277 Dec 20 06:02:23.358201 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-50b8e697-1690-418b-9a01-8324535f1d9a req-479e372d-17c3-4e25-b5dc-331e403637b3 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9 HTTP/1.1" status: 200 len: 1002 time: 0.0560517 Dec 20 06:02:23.407613 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b8e697-1690-418b-9a01-8324535f1d9a req-a817a453-389a-4b3d-bc6d-663ec13213d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:23.409060 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-50b8e697-1690-418b-9a01-8324535f1d9a req-a817a453-389a-4b3d-bc6d-663ec13213d8 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4b218758-bd28-403f-ac97-d980db9b78c8 HTTP/1.1" status: 200 len: 855 time: 0.0422738 Dec 20 06:02:23.456060 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b8e697-1690-418b-9a01-8324535f1d9a req-79bf1d75-fd32-4ce2-b6ee-e52ed94ab548 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:23.457407 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-50b8e697-1690-418b-9a01-8324535f1d9a req-79bf1d75-fd32-4ce2-b6ee-e52ed94ab548 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6623d855-6648-40fd-8a49-9c323edbff11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0408967 Dec 20 06:02:23.543342 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-50b8e697-1690-418b-9a01-8324535f1d9a req-e4ecfdde-c68f-436f-99bc-808d265dba97 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0778100 Dec 20 06:02:23.635841 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-50b8e697-1690-418b-9a01-8324535f1d9a req-0d751c9c-6dd9-4095-8113-c1318c83aa6c service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846193 Dec 20 06:02:23.708096 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e948762-b71d-4ace-881b-5e6eecfbbc1b req-6c1d81d1-19c9-44d7-98f4-bb079be6560f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:23.709469 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3e948762-b71d-4ace-881b-5e6eecfbbc1b req-6c1d81d1-19c9-44d7-98f4-bb079be6560f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0473328 Dec 20 06:02:23.753927 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3e948762-b71d-4ace-881b-5e6eecfbbc1b req-a926ba45-6d24-49e1-bfd3-2011336241f6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0386693 Dec 20 06:02:24.869244 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-096814a1-f46e-476d-b64c-8e5aef5cf973 req-e359e4fc-d5e7-4f17-8a92-64581936ca2c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:24.870763 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-096814a1-f46e-476d-b64c-8e5aef5cf973 req-e359e4fc-d5e7-4f17-8a92-64581936ca2c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0466759 Dec 20 06:02:24.919060 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-096814a1-f46e-476d-b64c-8e5aef5cf973 req-f803dc8f-f278-4c21-bf9b-526bcfc796d7 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425019 Dec 20 06:02:26.035076 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a68d1cf-a87c-43d5-8f1c-50c11962124f req-d96a97d8-1230-45b7-88a8-05669976e111 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:26.036591 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1a68d1cf-a87c-43d5-8f1c-50c11962124f req-d96a97d8-1230-45b7-88a8-05669976e111 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0466752 Dec 20 06:02:26.082152 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1a68d1cf-a87c-43d5-8f1c-50c11962124f req-31736837-d279-4e46-9343-321cafea442f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390944 Dec 20 06:02:26.949215 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e99e2be6-f423-4e2b-a430-35fc5ca2d401 req-9f2bf4a4-5fa6-4b79-ac15-ef80bd090fcf tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:26.950681 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e99e2be6-f423-4e2b-a430-35fc5ca2d401 req-9f2bf4a4-5fa6-4b79-ac15-ef80bd090fcf tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 946 time: 0.0481822 Dec 20 06:02:26.998741 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e99e2be6-f423-4e2b-a430-35fc5ca2d401 req-ea790257-03bd-4f99-9e06-962c54f8fb9f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414226 Dec 20 06:02:27.172122 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-c26cd24d-6d98-4edc-92e4-986b8cb66de8 req-8b8a6604-0306-4f57-a4c2-cd08c387eafd service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0385957 Dec 20 06:02:27.329968 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device e1d82060-6f66-481d-9c81-e9d5e1ed09f9 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:02:27.410388 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:27.433484 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:02:27.435794 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6978802f-5a0e-4d66-89fa-3d6542a7eca5" -d '{"events": [{"server_uuid": "accc1938-7113-4752-b1cb-e7b9b1c5b96f", "name": "network-vif-unplugged", "status": "completed", "tag": "e1d82060-6f66-481d-9c81-e9d5e1ed09f9"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:02:27.448065 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port e1d82060-6f66-481d-9c81-e9d5e1ed09f9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:02:27.453231 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:27.482940 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Mon, 20 Dec 2021 06:02:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-da9965ad-5f43-4f00-89cd-c62826ea2160 x-openstack-request-id: req-da9965ad-5f43-4f00-89cd-c62826ea2160 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:02:27.483235 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "accc1938-7113-4752-b1cb-e7b9b1c5b96f", "name": "network-vif-unplugged", "status": "failed", "tag": "e1d82060-6f66-481d-9c81-e9d5e1ed09f9", "code": 422}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:02:27.483492 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-da9965ad-5f43-4f00-89cd-c62826ea2160 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:02:27.483927 dv-cinder-822278-1-iscsi neutron-server[102447]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'code': 422} returned with failed status Dec 20 06:02:27.506340 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,revision_number=8']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:02:28.233693 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c26cd24d-6d98-4edc-92e4-986b8cb66de8 req-70a4c1c3-edfd-4c69-9438-6b82091441b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:28.235376 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c26cd24d-6d98-4edc-92e4-986b8cb66de8 req-70a4c1c3-edfd-4c69-9438-6b82091441b9 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f&tenant_id=60c21858b1c7408daa963605a7c691c0 HTTP/1.1" status: 200 len: 1097 time: 0.2897134 Dec 20 06:02:28.275268 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316151af-35ae-46cd-9083-92c76a67f374 req-c5f5ae11-b272-4b13-a862-05df134f1daf tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:28.276941 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-316151af-35ae-46cd-9083-92c76a67f374 req-c5f5ae11-b272-4b13-a862-05df134f1daf tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0565503 Dec 20 06:02:28.347992 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c26cd24d-6d98-4edc-92e4-986b8cb66de8 req-42e496bb-26cd-4cfb-805a-604cc6a41ab9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:28.349487 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c26cd24d-6d98-4edc-92e4-986b8cb66de8 req-42e496bb-26cd-4cfb-805a-604cc6a41ab9 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 1097 time: 0.0715759 Dec 20 06:02:28.353141 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-316151af-35ae-46cd-9083-92c76a67f374 req-c03fac03-82eb-44e8-a9b2-89185c9f4471 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0670540 Dec 20 06:02:28.440323 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c26cd24d-6d98-4edc-92e4-986b8cb66de8 req-c2a01079-0cd9-41b4-94b9-2f456e8c100f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:28.441797 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c26cd24d-6d98-4edc-92e4-986b8cb66de8 req-c2a01079-0cd9-41b4-94b9-2f456e8c100f service neutron] 10.222.0.54 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 917 time: 0.0857215 Dec 20 06:02:28.505144 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c26cd24d-6d98-4edc-92e4-986b8cb66de8 req-51158a5d-38ad-4f24-837c-4dd3ea145b3d service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9 HTTP/1.1" status: 200 len: 1000 time: 0.0562596 Dec 20 06:02:28.556128 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c26cd24d-6d98-4edc-92e4-986b8cb66de8 req-5167a9da-4c8e-45b7-b0fa-3f5c40762fb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:28.557466 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c26cd24d-6d98-4edc-92e4-986b8cb66de8 req-5167a9da-4c8e-45b7-b0fa-3f5c40762fb0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4b218758-bd28-403f-ac97-d980db9b78c8 HTTP/1.1" status: 200 len: 855 time: 0.0454395 Dec 20 06:02:28.601167 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c26cd24d-6d98-4edc-92e4-986b8cb66de8 req-161aa7c0-8c14-47ba-8a2b-c4d5c310b2bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:28.602617 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c26cd24d-6d98-4edc-92e4-986b8cb66de8 req-161aa7c0-8c14-47ba-8a2b-c4d5c310b2bd service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6623d855-6648-40fd-8a49-9c323edbff11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0381432 Dec 20 06:02:28.690946 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c26cd24d-6d98-4edc-92e4-986b8cb66de8 req-18eb72c2-9b93-4ddd-bb8d-a1b4f99b9fea service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0805964 Dec 20 06:02:28.780539 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c26cd24d-6d98-4edc-92e4-986b8cb66de8 req-14834c9e-9051-4e15-b62d-811ac51c0073 service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830224 Dec 20 06:02:29.494724 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b030a9da-8545-47ec-b458-6cf1b6ca0236 req-55518872-4bef-48ea-be76-2024561e7ad6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:29.496338 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b030a9da-8545-47ec-b458-6cf1b6ca0236 req-55518872-4bef-48ea-be76-2024561e7ad6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0560920 Dec 20 06:02:29.545560 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b030a9da-8545-47ec-b458-6cf1b6ca0236 req-32f6dab2-6b5f-4430-ac61-3bf73099840a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433738 Dec 20 06:02:30.675824 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b525e6-ddb9-47e8-a701-e7ac9b9b5b2c req-c23da479-6509-4780-890d-4780765966bd tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:30.677197 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a5b525e6-ddb9-47e8-a701-e7ac9b9b5b2c req-c23da479-6509-4780-890d-4780765966bd tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0550992 Dec 20 06:02:30.726879 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a5b525e6-ddb9-47e8-a701-e7ac9b9b5b2c req-9574f33d-8002-4810-93e3-e8298a82eac3 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429182 Dec 20 06:02:31.719605 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-cfbc703a-ce25-489b-9c9c-43ff50b5baf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:31.858004 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8111e8ec-a319-4711-a938-c9ec30935a34 req-189fb8dc-a580-43c6-99df-5896611216ff tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:31.860758 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8111e8ec-a319-4711-a938-c9ec30935a34 req-189fb8dc-a580-43c6-99df-5896611216ff tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0526829 Dec 20 06:02:31.909385 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8111e8ec-a319-4711-a938-c9ec30935a34 req-75b0f6af-5c13-4ada-a83f-000166da9622 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425854 Dec 20 06:02:32.967880 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:02:33.035910 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94f316a2-81d2-4cbd-9ea5-0fd4c1f9c184 req-a42d5cd0-d075-4225-8157-e5d85c1dd53d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:33.038082 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-94f316a2-81d2-4cbd-9ea5-0fd4c1f9c184 req-a42d5cd0-d075-4225-8157-e5d85c1dd53d tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0532725 Dec 20 06:02:33.092789 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-94f316a2-81d2-4cbd-9ea5-0fd4c1f9c184 req-c6837f90-3742-42e9-b571-e32806df22c1 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482247 Dec 20 06:02:34.169181 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-196b2aaa-cba1-480c-a907-2fe03b58649a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:34.218707 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b88accd9-901e-41ee-b2d4-c8afc6b5849d req-867e4362-64ea-41a4-9065-9d1a2d03b14c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:34.220338 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b88accd9-901e-41ee-b2d4-c8afc6b5849d req-867e4362-64ea-41a4-9065-9d1a2d03b14c tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0575936 Dec 20 06:02:34.273341 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b88accd9-901e-41ee-b2d4-c8afc6b5849d req-6e54c6b0-b39d-45a8-aecd-6d6f5e4d5f09 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471804 Dec 20 06:02:35.001979 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:35.395159 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-470169a5-9c20-4fad-b62c-0afb29bd55a5 req-ec078a48-baec-4613-b95a-90c887742c42 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:35.396759 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-470169a5-9c20-4fad-b62c-0afb29bd55a5 req-ec078a48-baec-4613-b95a-90c887742c42 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0494168 Dec 20 06:02:35.451033 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-470169a5-9c20-4fad-b62c-0afb29bd55a5 req-0c0e6dc3-58c7-4e7f-86ed-f4cecbc8728e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0472980 Dec 20 06:02:36.500351 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:36.585950 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66133771-f080-4aa7-826a-277deb0f77f4 req-48ed2d1d-215a-4bfc-a80e-ef734a968542 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:36.587662 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-66133771-f080-4aa7-826a-277deb0f77f4 req-48ed2d1d-215a-4bfc-a80e-ef734a968542 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0499823 Dec 20 06:02:36.639482 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-66133771-f080-4aa7-826a-277deb0f77f4 req-239b7bbc-3ff4-4d64-9c92-c179d8bdb364 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455015 Dec 20 06:02:37.581257 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:37.761033 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d8ba11-54f7-49c0-8f05-858522424a50 req-9b423b5c-4090-4eb3-a2d4-ff10f9ac1291 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:37.770686 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-90d8ba11-54f7-49c0-8f05-858522424a50 req-9b423b5c-4090-4eb3-a2d4-ff10f9ac1291 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0591955 Dec 20 06:02:37.824790 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-90d8ba11-54f7-49c0-8f05-858522424a50 req-ad9d7416-019a-481d-8a77-366663a7b9cd tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482035 Dec 20 06:02:38.759131 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:38.951004 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37b6b159-91d1-485f-ace7-1a945026dda1 req-54d5ef80-eeef-4e44-92f4-af2ac97bc926 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:38.952786 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37b6b159-91d1-485f-ace7-1a945026dda1 req-54d5ef80-eeef-4e44-92f4-af2ac97bc926 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0514741 Dec 20 06:02:38.998609 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37b6b159-91d1-485f-ace7-1a945026dda1 req-e6d3eb64-c63d-44b1-a99c-7f4aa6a0b0cf tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397866 Dec 20 06:02:40.124086 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b93d0a2e-3fe2-4204-976e-9dcf685c664f req-6f5f114f-3473-4b90-b9e7-29d47098800f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:40.125593 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b93d0a2e-3fe2-4204-976e-9dcf685c664f req-6f5f114f-3473-4b90-b9e7-29d47098800f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0567632 Dec 20 06:02:40.171215 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b93d0a2e-3fe2-4204-976e-9dcf685c664f req-600d322a-3787-47ba-9c46-61af9193c7b2 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397325 Dec 20 06:02:41.287151 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fe0585-3d1b-45fd-8b58-4fc0e2eda5a8 req-cba4890c-c6e1-4f13-9519-95185a79ed6e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:41.288632 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e7fe0585-3d1b-45fd-8b58-4fc0e2eda5a8 req-cba4890c-c6e1-4f13-9519-95185a79ed6e tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 944 time: 0.0467103 Dec 20 06:02:41.337398 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e7fe0585-3d1b-45fd-8b58-4fc0e2eda5a8 req-bbe2d0c9-1a11-44d6-9385-77545adb51cd tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425417 Dec 20 06:02:41.354988 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device e1d82060-6f66-481d-9c81-e9d5e1ed09f9 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 06:02:41.449791 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port e1d82060-6f66-481d-9c81-e9d5e1ed09f9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:02:41.460729 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'port_id': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'mac_address': 'fa:16:3e:f5:4b:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 414, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 06:02:41.496773 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:41.512184 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e1d82060-6f66-481d-9c81-e9d5e1ed09f9 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:02:41.530978 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port e1d82060-6f66-481d-9c81-e9d5e1ed09f9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:02:41.535070 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:41.578966 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,revision_number=9']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:02:41.832055 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['e1d82060-6f66-481d-9c81-e9d5e1ed09f9'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:02:42.456767 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87386d6d-4223-4c03-b731-f13bf0b9546d req-0463eb10-3072-4b55-95b1-0f59c8dfa2e6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:42.458216 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-87386d6d-4223-4c03-b731-f13bf0b9546d req-0463eb10-3072-4b55-95b1-0f59c8dfa2e6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 945 time: 0.0492179 Dec 20 06:02:42.502990 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-87386d6d-4223-4c03-b731-f13bf0b9546d req-9f4d4132-757a-449b-994d-2fef8ebce4f5 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388436 Dec 20 06:02:43.374562 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e61e7b8b-4c1c-4e81-81ce-fb337c44c361 req-408ef3c4-d3c0-4123-a70a-1680700d2f2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:43.376594 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e61e7b8b-4c1c-4e81-81ce-fb337c44c361 req-408ef3c4-d3c0-4123-a70a-1680700d2f2b service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=60c21858b1c7408daa963605a7c691c0&device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 1098 time: 0.0417194 Dec 20 06:02:43.394780 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device e1d82060-6f66-481d-9c81-e9d5e1ed09f9 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 06:02:43.458662 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port e1d82060-6f66-481d-9c81-e9d5e1ed09f9 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 06:02:43.460214 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:43.509214 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e61e7b8b-4c1c-4e81-81ce-fb337c44c361 req-3c2680e6-a5d3-4dca-9800-bad355a12778 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:43.510718 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e61e7b8b-4c1c-4e81-81ce-fb337c44c361 req-3c2680e6-a5d3-4dca-9800-bad355a12778 service neutron] 10.222.0.54 "GET /v2.0/networks?id=6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 200 len: 917 time: 0.1093645 Dec 20 06:02:43.547068 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:43.570642 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:02:43.573020 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af973c26-89e6-4232-bec5-f218548a969e" -d '{"events": [{"server_uuid": "accc1938-7113-4752-b1cb-e7b9b1c5b96f", "name": "network-vif-plugged", "status": "completed", "tag": "e1d82060-6f66-481d-9c81-e9d5e1ed09f9"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:02:43.575584 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e61e7b8b-4c1c-4e81-81ce-fb337c44c361 req-5cdccbb9-ef82-4c7e-9ac0-72f7322b34b2 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9 HTTP/1.1" status: 200 len: 1001 time: 0.0574913 Dec 20 06:02:43.586941 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port e1d82060-6f66-481d-9c81-e9d5e1ed09f9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:02:43.591805 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:02:43.620221 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:02:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f5fab57-6722-4336-a238-2777191a6380 x-openstack-request-id: req-7f5fab57-6722-4336-a238-2777191a6380 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:02:43.620512 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "accc1938-7113-4752-b1cb-e7b9b1c5b96f", "name": "network-vif-plugged", "status": "completed", "tag": "e1d82060-6f66-481d-9c81-e9d5e1ed09f9", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:02:43.620766 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-7f5fab57-6722-4336-a238-2777191a6380 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:02:43.621155 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'code': 200} Dec 20 06:02:43.644596 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,revision_number=10']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:02:43.661506 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10923200-76d1-4183-8760-6baa7ba9529f req-8ee90b48-3f8e-48b0-9293-7023b16aaaaa tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:43.663011 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-10923200-76d1-4183-8760-6baa7ba9529f req-8ee90b48-3f8e-48b0-9293-7023b16aaaaa tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 945 time: 0.0867398 Dec 20 06:02:43.669300 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e61e7b8b-4c1c-4e81-81ce-fb337c44c361 req-4a284791-7375-44f9-a0bc-9f8a1b1d7729 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:43.670691 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e61e7b8b-4c1c-4e81-81ce-fb337c44c361 req-4a284791-7375-44f9-a0bc-9f8a1b1d7729 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=4b218758-bd28-403f-ac97-d980db9b78c8 HTTP/1.1" status: 200 len: 855 time: 0.0654173 Dec 20 06:02:43.736222 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-10923200-76d1-4183-8760-6baa7ba9529f req-7bd84b45-ddfe-4ddb-856d-00992b8df67f tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0645788 Dec 20 06:02:43.745442 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e61e7b8b-4c1c-4e81-81ce-fb337c44c361 req-1bebbc3f-5ea7-4a59-af98-2c389720bdbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:43.746886 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e61e7b8b-4c1c-4e81-81ce-fb337c44c361 req-1bebbc3f-5ea7-4a59-af98-2c389720bdbe service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=6623d855-6648-40fd-8a49-9c323edbff11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0514784 Dec 20 06:02:43.845704 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e61e7b8b-4c1c-4e81-81ce-fb337c44c361 req-e0ac1aff-fdd5-4c7e-9111-95af7e74cc9c service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852208 Dec 20 06:02:43.859653 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b110b378-7b65-4d52-97fb-c82e65af0828 req-d478686d-78f1-4c7b-a2c4-cadc4ce68953 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:43.861123 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-b110b378-7b65-4d52-97fb-c82e65af0828 req-d478686d-78f1-4c7b-a2c4-cadc4ce68953 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 1100 time: 0.0430818 Dec 20 06:02:43.904118 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-b110b378-7b65-4d52-97fb-c82e65af0828 req-ddb9c3ad-c455-4227-9ee4-db7537b4cfc0 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0360827 Dec 20 06:02:43.934272 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e61e7b8b-4c1c-4e81-81ce-fb337c44c361 req-e241a0e5-411b-4240-89c5-fd3f0d6c6c1a service neutron] 10.222.0.54 "GET /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818596 Dec 20 06:02:44.871462 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bcdd68b-e6e4-4fb5-a06a-e98d660d5168 req-c7d56ff0-7301-432b-acf8-173f38f0a56a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:44.872958 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8bcdd68b-e6e4-4fb5-a06a-e98d660d5168 req-c7d56ff0-7301-432b-acf8-173f38f0a56a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 947 time: 0.0571170 Dec 20 06:02:44.917820 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8bcdd68b-e6e4-4fb5-a06a-e98d660d5168 req-e57c96eb-18bc-4ea7-ba06-74a79463f628 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389214 Dec 20 06:02:46.033669 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29c0abc6-6bb8-43e7-93d4-38ecdf0c9082 req-b28ba864-1d9a-4aab-806e-5d92fca580a6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:02:46.035138 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-29c0abc6-6bb8-43e7-93d4-38ecdf0c9082 req-b28ba864-1d9a-4aab-806e-5d92fca580a6 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 947 time: 0.0475404 Dec 20 06:02:46.084177 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-29c0abc6-6bb8-43e7-93d4-38ecdf0c9082 req-b2cd292c-e59c-4128-89be-d7bd4800d969 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432022 Dec 20 06:03:01.721154 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-8dce9d6d-2a47-4b0f-b017-569285269624 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:04.162017 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-2326ae8a-9758-47fe-b48b-4eb88b0a726b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:05.004222 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:06.501055 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:07.574231 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:08.781153 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:09.968270 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:03:18.594267 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a82d374e-d5e0-4063-89c4-30a6d34c3b1c req-84cfb531-02d7-4fdb-a45e-d8a3d0255b74 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:18.595625 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a82d374e-d5e0-4063-89c4-30a6d34c3b1c req-84cfb531-02d7-4fdb-a45e-d8a3d0255b74 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 947 time: 0.0496328 Dec 20 06:03:18.640514 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a82d374e-d5e0-4063-89c4-30a6d34c3b1c req-eae4cb5c-78da-4c9d-a79a-11e40bc5bf61 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390458 Dec 20 06:03:19.757330 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e75bc7d9-c717-43ed-8a16-7e3c9dcc3324 req-a5028c37-f70d-4216-9f90-ce2a5ed4d633 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:19.758789 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e75bc7d9-c717-43ed-8a16-7e3c9dcc3324 req-a5028c37-f70d-4216-9f90-ce2a5ed4d633 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 947 time: 0.0476515 Dec 20 06:03:19.804369 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e75bc7d9-c717-43ed-8a16-7e3c9dcc3324 req-beff742c-a2bd-4a43-8d0a-62982e0d45b7 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups?id=c39f6923-1297-48d1-8a30-e4715445fe4f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398865 Dec 20 06:03:20.140259 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-25101a14-812a-4cb5-873d-596a8fc3aa6a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:20.141699 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-25101a14-812a-4cb5-873d-596a8fc3aa6a tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.54 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 947 time: 0.0460079 Dec 20 06:03:20.240804 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Deleting port e1d82060-6f66-481d-9c81-e9d5e1ed09f9 {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:03:20.241139 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:20.332369 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] For port e1d82060-6f66-481d-9c81-e9d5e1ed09f9, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:03:20.332642 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:20.499342 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:20.499728 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:20.500041 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.l3_db [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Floating IP bb196bd1-e4ff-493d-8d0c-b3ed5c68d84f disassociated. External IP: 172.27.3.109, port: e1d82060-6f66-481d-9c81-e9d5e1ed09f9. Dec 20 06:03:20.500379 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Calling delete_port for e1d82060-6f66-481d-9c81-e9d5e1ed09f9 owned by compute:nova {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:03:20.647755 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:20.678059 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event deleted for resources: {'Port': ['ID=e1d82060-6f66-481d-9c81-e9d5e1ed09f9,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:20.688450 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:20.688791 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:20.689139 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:20.689476 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:20.689806 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:20.690135 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:20.690460 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:20.690787 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:20.691106 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:20.691425 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:20.691769 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:20.692092 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:20.692410 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:20.798417 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Router c3741b68-c75b-409c-9c20-6d6808f6e838 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:03:20.913246 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1d25d544-ce6c-4558-864d-fe3d44261e70 req-ac272ac7-2671-46fe-8ffc-8703126e3b78 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/ports?device_id=accc1938-7113-4752-b1cb-e7b9b1c5b96f HTTP/1.1" status: 200 len: 210 time: 0.0332561 Dec 20 06:03:20.926104 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:03:20.937273 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-771d7e9a-ca63-4890-b780-c3ea0428d579 None None] Sync routers for ids ['c3741b68-c75b-409c-9c20-6d6808f6e838'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:03:20.947730 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-771d7e9a-ca63-4890-b780-c3ea0428d579 None None] Routers {'c3741b68-c75b-409c-9c20-6d6808f6e838'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:03:20.948275 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-771d7e9a-ca63-4890-b780-c3ea0428d579 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:03:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['c3741b68-c75b-409c-9c20-6d6808f6e838'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:20.968189 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] No DVR routers for this DVR port e1d82060-6f66-481d-9c81-e9d5e1ed09f9 on host hv-cinder-82227 {{(pid=102445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:03:20.970705 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:20.974062 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-85630e59-44c4-47cd-9091-12c125fd59f5 req-8b3bbde5-7e3d-4ce8-a37a-037d94610b86 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.54 "DELETE /v2.0/ports/e1d82060-6f66-481d-9c81-e9d5e1ed09f9 HTTP/1.1" status: 204 len: 173 time: 0.8260942 Dec 20 06:03:20.974502 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'name': 'network-vif-deleted', 'tag': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:03:20.976750 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1dbdb967-8783-4953-a432-ad1e596d632c" -d '{"events": [{"server_uuid": "accc1938-7113-4752-b1cb-e7b9b1c5b96f", "name": "network-vif-deleted", "tag": "e1d82060-6f66-481d-9c81-e9d5e1ed09f9"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:03:21.019192 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:03:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0b051f23-daa5-478c-8b18-afcb9a633dee x-openstack-request-id: req-0b051f23-daa5-478c-8b18-afcb9a633dee {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:03:21.019493 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "accc1938-7113-4752-b1cb-e7b9b1c5b96f", "name": "network-vif-deleted", "tag": "e1d82060-6f66-481d-9c81-e9d5e1ed09f9", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:03:21.019776 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-0b051f23-daa5-478c-8b18-afcb9a633dee {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:03:21.020178 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'accc1938-7113-4752-b1cb-e7b9b1c5b96f', 'name': 'network-vif-deleted', 'tag': 'e1d82060-6f66-481d-9c81-e9d5e1ed09f9', 'status': 'completed', 'code': 200} Dec 20 06:03:21.066273 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-771d7e9a-ca63-4890-b780-c3ea0428d579 None None] Set router c3741b68-c75b-409c-9c20-6d6808f6e838 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:03:21.283160 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-771d7e9a-ca63-4890-b780-c3ea0428d579 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:17Z', 'revision_number': 5, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:21.308876 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-771d7e9a-ca63-4890-b780-c3ea0428d579 None None] Checking router: c3741b68-c75b-409c-9c20-6d6808f6e838 for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:03:21.316925 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-771d7e9a-ca63-4890-b780-c3ea0428d579 None None] Routers {'c3741b68-c75b-409c-9c20-6d6808f6e838'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:03:21.317521 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-771d7e9a-ca63-4890-b780-c3ea0428d579 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:03:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['c3741b68-c75b-409c-9c20-6d6808f6e838'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:21.503760 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-771d7e9a-ca63-4890-b780-c3ea0428d579 None None] Set router c3741b68-c75b-409c-9c20-6d6808f6e838 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:03:21.693126 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-771d7e9a-ca63-4890-b780-c3ea0428d579 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:17Z', 'revision_number': 5, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:21.722873 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-771d7e9a-ca63-4890-b780-c3ea0428d579 None None] The sync data for ids ['c3741b68-c75b-409c-9c20-6d6808f6e838'] in dv-cinder-822278-1-iscsi is: [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:13Z', 'revision_number': 4, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': '3a13ccf0-993a-4501-8cda-0acd8d7cbf9a', 'name': '', 'network_id': '6623d855-6648-40fd-8a49-9c323edbff11', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'mac_address': 'fa:16:3e:2d:ec:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:12Z', 'updated_at': '2021-12-20T05:58:17Z', 'revision_number': 5, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'subnets': [{'id': '4b218758-bd28-403f-ac97-d980db9b78c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:03:21.923855 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1d98979-af15-4e8b-b563-6c3b4b4b04a5 None None] New status for floating IP bb196bd1-e4ff-493d-8d0c-b3ed5c68d84f: DOWN {{(pid=102447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 06:03:22.003444 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50810) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:03:22.059280 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:22.084459 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:22.131371 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:22.134080 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:22.138164 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "DELETE /v2.0/security-groups/c39f6923-1297-48d1-8a30-e4715445fe4f HTTP/1.1" status: 204 len: 168 time: 0.1307714 Dec 20 06:03:22.138647 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50812) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:03:22.144753 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c39f6923-1297-48d1-8a30-e4715445fe4f,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:22.152089 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:22.152447 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:22.152631 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.api.v2.resource [None req-eb5e451e-996f-4560-abc9-12643cdb6e09 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] show failed (client error): The resource could not be found. Dec 20 06:03:22.152789 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:22.153124 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:22.153462 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:22.156568 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:22.156689 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-eb5e451e-996f-4560-abc9-12643cdb6e09 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "GET /v2.0/security-groups/c39f6923-1297-48d1-8a30-e4715445fe4f HTTP/1.1" status: 404 len: 347 time: 0.0136774 Dec 20 06:03:22.156792 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:22.156792 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:22.156792 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:22.156792 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:22.156792 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:22.156792 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:22.156792 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de942a3-9c60-494f-8e94-e40a67ea88e9 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:22.157326 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50814) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:03:22.287710 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-13bfaab6-08f4-4f2e-b5d8-c5364c8f6522 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Deleting port 7c95581e-b88c-4f42-a0ab-fc0e2fb2b4de {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:03:22.288051 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-13bfaab6-08f4-4f2e-b5d8-c5364c8f6522 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:22.366747 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-13bfaab6-08f4-4f2e-b5d8-c5364c8f6522 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:22.367073 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-13bfaab6-08f4-4f2e-b5d8-c5364c8f6522 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:22.378968 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-13bfaab6-08f4-4f2e-b5d8-c5364c8f6522 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Calling delete_port for 7c95581e-b88c-4f42-a0ab-fc0e2fb2b4de owned by network:floatingip {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:03:22.506917 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-13bfaab6-08f4-4f2e-b5d8-c5364c8f6522 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:22.529754 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13bfaab6-08f4-4f2e-b5d8-c5364c8f6522 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Pushing event deleted for resources: {'Port': ['ID=7c95581e-b88c-4f42-a0ab-fc0e2fb2b4de,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:22.589263 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-13bfaab6-08f4-4f2e-b5d8-c5364c8f6522 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks [] for floatingip, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:22.592444 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-13bfaab6-08f4-4f2e-b5d8-c5364c8f6522 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:22.593581 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-13bfaab6-08f4-4f2e-b5d8-c5364c8f6522 tempest-AttachVolumeShelveTestJSON-1325307410 tempest-AttachVolumeShelveTestJSON-1325307410-project] 10.222.0.46 "DELETE /v2.0/floatingips/bb196bd1-e4ff-493d-8d0c-b3ed5c68d84f HTTP/1.1" status: 204 len: 168 time: 0.4361207 Dec 20 06:03:23.553008 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device e1d82060-6f66-481d-9c81-e9d5e1ed09f9 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:03:23.573159 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: e1d82060-6f66-481d-9c81-e9d5e1ed09f9 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:03:23.573495 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device e1d82060-6f66-481d-9c81-e9d5e1ed09f9 not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:03:24.991428 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50836) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:03:25.461083 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-385c5a08-a306-47b2-a673-0840995ad778 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1697024'] for router_interface, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:25.696412 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-385c5a08-a306-47b2-a673-0840995ad778 admin admin] Deleting port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:03:25.696647 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-385c5a08-a306-47b2-a673-0840995ad778 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:25.771397 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [None req-385c5a08-a306-47b2-a673-0840995ad778 admin admin] For port 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=3a13ccf0-993a-4501-8cda-0acd8d7cbf9a,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:03:25.771808 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-385c5a08-a306-47b2-a673-0840995ad778 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:25.784262 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-385c5a08-a306-47b2-a673-0840995ad778 admin admin] Calling delete_port for 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a owned by network:router_interface {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:03:26.190053 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-385c5a08-a306-47b2-a673-0840995ad778 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:26.219619 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-385c5a08-a306-47b2-a673-0840995ad778 admin admin] Pushing event deleted for resources: {'Port': ['ID=3a13ccf0-993a-4501-8cda-0acd8d7cbf9a,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:26.404625 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-385c5a08-a306-47b2-a673-0840995ad778 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1617481', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1697260'] for router_interface, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:26.610714 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-385c5a08-a306-47b2-a673-0840995ad778 admin admin] Router c3741b68-c75b-409c-9c20-6d6808f6e838 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:03:26.712571 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-385c5a08-a306-47b2-a673-0840995ad778 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:03:26.720010 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-385c5a08-a306-47b2-a673-0840995ad778 admin admin] 10.222.0.46 "PUT /v2.0/routers/c3741b68-c75b-409c-9c20-6d6808f6e838/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7251091 Dec 20 06:03:26.720231 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50840) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:03:26.721102 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3702e05-6acc-4dbe-9188-afe39555bb28 None None] Sync routers for ids ['c3741b68-c75b-409c-9c20-6d6808f6e838'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:03:26.731818 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3702e05-6acc-4dbe-9188-afe39555bb28 None None] Routers {'c3741b68-c75b-409c-9c20-6d6808f6e838'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:03:26.732420 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-a3702e05-6acc-4dbe-9188-afe39555bb28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:03:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['c3741b68-c75b-409c-9c20-6d6808f6e838'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:26.823375 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] Publish callbacks [] for router, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:26.833088 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-a3702e05-6acc-4dbe-9188-afe39555bb28 None None] Set router c3741b68-c75b-409c-9c20-6d6808f6e838 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:03:26.923124 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:26.974008 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] Deleting port 226ec1ab-63e5-4186-886b-18e890bcbd84 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:03:26.974354 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.004541 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-a3702e05-6acc-4dbe-9188-afe39555bb28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84'}], 'enable_snat': True}, 'gw_port_id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T06:03:26Z', 'revision_number': 5, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port': {'id': '226ec1ab-63e5-4186-886b-18e890bcbd84', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e3:7c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'device_owner': 'network:router_gateway', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T05:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:27.030622 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3702e05-6acc-4dbe-9188-afe39555bb28 None None] Checking router: c3741b68-c75b-409c-9c20-6d6808f6e838 for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:03:27.038629 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3702e05-6acc-4dbe-9188-afe39555bb28 None None] Routers {'c3741b68-c75b-409c-9c20-6d6808f6e838'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:03:27.039226 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-a3702e05-6acc-4dbe-9188-afe39555bb28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:03:04Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['c3741b68-c75b-409c-9c20-6d6808f6e838'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:27.054544 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] For port 226ec1ab-63e5-4186-886b-18e890bcbd84, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=226ec1ab-63e5-4186-886b-18e890bcbd84,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:03:27.054909 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.066475 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] Calling delete_port for 226ec1ab-63e5-4186-886b-18e890bcbd84 owned by network:router_gateway {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:03:27.123176 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-a3702e05-6acc-4dbe-9188-afe39555bb28 None None] Set router c3741b68-c75b-409c-9c20-6d6808f6e838 gateway port host: None {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:03:27.176149 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-a3702e05-6acc-4dbe-9188-afe39555bb28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T06:03:26Z', 'revision_number': 6, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port_host': None}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:27.201969 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3702e05-6acc-4dbe-9188-afe39555bb28 None None] The sync data for ids ['c3741b68-c75b-409c-9c20-6d6808f6e838'] in dv-cinder-822278-1-iscsi is: [{'id': 'c3741b68-c75b-409c-9c20-6d6808f6e838', 'name': 'tempest-AttachVolumeShelveTestJSON-915509005-router', 'tenant_id': '60c21858b1c7408daa963605a7c691c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:10Z', 'updated_at': '2021-12-20T06:03:26Z', 'revision_number': 6, 'project_id': '60c21858b1c7408daa963605a7c691c0', 'gw_port_host': None}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:03:27.228300 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.254393 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] Pushing event deleted for resources: {'Port': ['ID=226ec1ab-63e5-4186-886b-18e890bcbd84,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:27.310168 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1703502'] for router_gateway, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.399452 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1698526', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25973'] for router, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.401597 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.442109 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1698533'] for router, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.442515 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] Fanout notify agent at l3_agent the message router_deleted on router c3741b68-c75b-409c-9c20-6d6808f6e838 {{(pid=102446) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 20 06:03:27.446738 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] Publish callbacks [] for router, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.447924 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-aa7e2d44-57f5-48ee-ae1c-65a4439f0612 admin admin] 10.222.0.46 "DELETE /v2.0/routers/c3741b68-c75b-409c-9c20-6d6808f6e838 HTTP/1.1" status: 204 len: 168 time: 0.7266002 Dec 20 06:03:27.450787 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50842) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:03:27.493299 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_v2 [None req-9a7e0021-41fc-4a54-83f5-ae88e7cb5a68 admin admin] Deleting subnet 4b218758-bd28-403f-ac97-d980db9b78c8 {{(pid=102446) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 06:03:27.496142 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9a7e0021-41fc-4a54-83f5-ae88e7cb5a68 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.529834 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9a7e0021-41fc-4a54-83f5-ae88e7cb5a68 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8976279'] for subnet, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.612121 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9a7e0021-41fc-4a54-83f5-ae88e7cb5a68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.662801 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9a7e0021-41fc-4a54-83f5-ae88e7cb5a68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9173344', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3270978'] for subnet, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.687299 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a7e0021-41fc-4a54-83f5-ae88e7cb5a68 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4b218758-bd28-403f-ac97-d980db9b78c8,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:27.690979 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-9a7e0021-41fc-4a54-83f5-ae88e7cb5a68 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.696316 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-9a7e0021-41fc-4a54-83f5-ae88e7cb5a68 admin admin] 10.222.0.46 "DELETE /v2.0/subnets/4b218758-bd28-403f-ac97-d980db9b78c8 HTTP/1.1" status: 204 len: 168 time: 0.2421110 Dec 20 06:03:27.697167 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50844) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:03:27.704117 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-023f053d-ef81-44ad-95e9-82f84239fb79 None None] Network 6623d855-6648-40fd-8a49-9c323edbff11 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 06:03:27.768393 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.819948 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Deleting port a8c210f0-0302-4306-949e-a42cbb928e73 {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:03:27.820289 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.880475 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] For port a8c210f0-0302-4306-949e-a42cbb928e73, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=a8c210f0-0302-4306-949e-a42cbb928e73,segment=NetworkSegment(c44c7219-40a7-4f55-8e90-10f68acf14be),segment_id=c44c7219-40a7-4f55-8e90-10f68acf14be)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:03:27.880754 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:27.896682 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Calling delete_port for a8c210f0-0302-4306-949e-a42cbb928e73 owned by network:dhcp {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:03:27.972826 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-512f0579-7bcb-489d-94b6-370e4b39c5ef None None] DHCP port deletion for 6623d855-6648-40fd-8a49-9c323edbff11 request from dv-cinder-822278-1-iscsi {{(pid=102447) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 20 06:03:27.975306 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:28.003437 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Pushing event deleted for resources: {'Port': ['ID=a8c210f0-0302-4306-949e-a42cbb928e73,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:28.005278 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] No DVR routers for this DVR port a8c210f0-0302-4306-949e-a42cbb928e73 on host dv-cinder-822278-1-iscsi {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:03:28.078493 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:28.098992 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6623d855-6648-40fd-8a49-9c323edbff11']}} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:28.108563 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c44c7219-40a7-4f55-8e90-10f68acf14be') {'for_net_delete': True} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:28.108864 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c44c7219-40a7-4f55-8e90-10f68acf14be') {} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:28.115150 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:03:28.118563 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8976286'] for segment, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:28.132035 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:28.137975 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Releasing vlan 414 on physical network physnet1 to pool {{(pid=102446) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 06:03:28.138371 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9173254'] for segment, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: Traceback (most recent call last): Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: timer() Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: cb(*args, **kw) Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: return func(*args, **kwargs) Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: self._notify() Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: self.callback(batched_events) Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: event.method(event) Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: return f(self, *a, **k) Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._get(url).json() Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: return self.request(url, 'GET', **kwargs) Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 06:03:28.140123 dv-cinder-822278-1-iscsi neutron-server[102446]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 06:03:28.142210 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:03:28.142210 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 3a13ccf0-993a-4501-8cda-0acd8d7cbf9a not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:03:28.142210 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device a8c210f0-0302-4306-949e-a42cbb928e73 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:03:28.161784 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: a8c210f0-0302-4306-949e-a42cbb928e73 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:03:28.162131 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device a8c210f0-0302-4306-949e-a42cbb928e73 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:03:28.162543 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 226ec1ab-63e5-4186-886b-18e890bcbd84 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:03:28.182260 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 226ec1ab-63e5-4186-886b-18e890bcbd84 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:03:28.182810 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 226ec1ab-63e5-4186-886b-18e890bcbd84 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:03:28.198065 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:28.203963 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:28.207181 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] 10.222.0.46 "DELETE /v2.0/networks/6623d855-6648-40fd-8a49-9c323edbff11 HTTP/1.1" status: 204 len: 168 time: 0.5097053 Dec 20 06:03:28.219150 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d20bd28c-e8fa-4c21-b556-49714fd2271e admin admin] Pushing event deleted for resources: {'Network': ['ID=6623d855-6648-40fd-8a49-9c323edbff11,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:28.327354 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50848) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:03:28.370124 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-1542198d-706e-4bdb-b590-3f8d821cb53d admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=60c21858b1c7408daa963605a7c691c0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0414302 Dec 20 06:03:28.372487 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50850) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:03:28.430726 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-77df56c1-1e1e-4fbe-b6e9-0023d1ca1ddd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:28.450717 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-77df56c1-1e1e-4fbe-b6e9-0023d1ca1ddd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:28.495706 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-77df56c1-1e1e-4fbe-b6e9-0023d1ca1ddd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:28.498297 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-77df56c1-1e1e-4fbe-b6e9-0023d1ca1ddd admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:28.499436 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-77df56c1-1e1e-4fbe-b6e9-0023d1ca1ddd admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/cd93ba0b-00c3-4528-bc0e-354d7e00ef52 HTTP/1.1" status: 204 len: 168 time: 0.1260600 Dec 20 06:03:28.506904 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77df56c1-1e1e-4fbe-b6e9-0023d1ca1ddd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd93ba0b-00c3-4528-bc0e-354d7e00ef52,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:29.139275 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 50872) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:03:29.232051 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-174582162-network', 'tenant_id': '6c4d4d4e246d4f11a44ae2ec00c29b78'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:03:29.253123 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] Made reservation on behalf of 6c4d4d4e246d4f11a44ae2ec00c29b78 for: {'network': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 06:03:29.255336 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for network, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:29.264104 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:29.337602 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:29.341445 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:29.361651 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] vlan segment allocate from pool success with {'vlan_id': 402, 'physical_network': 'physnet1'} {{(pid=102445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 20 06:03:29.375667 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=431e66e8-8619-4db8-a889-74e1d4924b6c,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:29.380462 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:29.380790 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.segments_db [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] Added segment effad741-91d1-454a-b4c1-664343a009d1 of type vlan for network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 Dec 20 06:03:29.421528 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8746766741041'] for network, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:29.445709 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502'] for network, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:29.446834 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:29.447419 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:29.480525 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] 10.222.0.46 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3396173 Dec 20 06:03:29.483601 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 50876) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:03:29.488456 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-d60fbb72-3b4d-4d3b-8b55-bc68d0d5172a admin admin] Request body: {'subnet': {'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-174582162-subnet', 'tenant_id': '6c4d4d4e246d4f11a44ae2ec00c29b78', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:03:29.511045 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d60fbb72-3b4d-4d3b-8b55-bc68d0d5172a admin admin] Made reservation on behalf of 6c4d4d4e246d4f11a44ae2ec00c29b78 for: {'subnet': 1} {{(pid=102446) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 06:03:29.512527 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdcc22dc-2587-47f3-a769-40a275b29ac6 admin admin] Pushing event updated for resources: {'Network': ['ID=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:29.513268 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d60fbb72-3b4d-4d3b-8b55-bc68d0d5172a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3270951'] for subnet, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:29.522399 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 details requested by agent ovs-agent-dv-cinder-822278-1-iscsi with host dv-cinder-822278-1-iscsi {{(pid=102447) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 20 06:03:29.675694 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d60fbb72-3b4d-4d3b-8b55-bc68d0d5172a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-9168037', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3270985'] for subnet, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:29.732632 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d60fbb72-3b4d-4d3b-8b55-bc68d0d5172a admin admin] Pushing event updated for resources: {'Subnet': ['ID=2bcf78d9-c760-46c0-85ca-57868ab46b20,revision_number=0']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:29.740882 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d60fbb72-3b4d-4d3b-8b55-bc68d0d5172a admin admin] Checking segment: {'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 06:03:29.741225 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d60fbb72-3b4d-4d3b-8b55-bc68d0d5172a admin admin] Network hostable DHCP agents. Network: fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9, hostable agents: ['b823c403-7856-4d0f-ac56-c8fdd3fdc1c6'], hosted agents: [] {{(pid=102446) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 20 06:03:29.757402 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d60fbb72-3b4d-4d3b-8b55-bc68d0d5172a admin admin] Network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 is scheduled to be hosted by DHCP agent b823c403-7856-4d0f-ac56-c8fdd3fdc1c6 with binding_index 1 {{(pid=102446) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 20 06:03:29.766210 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-d60fbb72-3b4d-4d3b-8b55-bc68d0d5172a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-822278-1-iscsi, fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9) {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 06:03:29.770656 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d60fbb72-3b4d-4d3b-8b55-bc68d0d5172a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:29.771739 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-d60fbb72-3b4d-4d3b-8b55-bc68d0d5172a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:29.775617 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac7dc840-df61-452f-a20a-a0507b23b04a None None] Network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 06:03:29.788056 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-d60fbb72-3b4d-4d3b-8b55-bc68d0d5172a admin admin] 10.222.0.46 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3031802 Dec 20 06:03:29.873664 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9fdbdfc7-4f22-4066-bcaf-0f34e06fe73e None None] Network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 06:03:30.292565 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-3ddc4793-8595-40ef-bf13-743f4c507e27 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:30.293949 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-3ddc4793-8595-40ef-bf13-743f4c507e27 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/networks?id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 HTTP/1.1" status: 200 len: 814 time: 0.0992105 Dec 20 06:03:30.308346 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-cae40a84-3589-4549-802a-2f7e1be07482 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/quotas/6c4d4d4e246d4f11a44ae2ec00c29b78 HTTP/1.1" status: 200 len: 375 time: 0.0086796 Dec 20 06:03:30.344624 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-505b0ea9-af28-4e9e-afca-9dce89cdd37e tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c4d4d4e246d4f11a44ae2ec00c29b78&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0305364 Dec 20 06:03:30.430783 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-d6da0a8e-bec0-425f-9ef2-f767c06ed5ce service neutron] 10.222.0.46 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0793684 Dec 20 06:03:30.520395 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-ed05baf4-0f26-4674-9d70-a07801b0468f service neutron] 10.222.0.46 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831776 Dec 20 06:03:30.722790 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6382ab03-6b6d-4bd7-b980-b0da93660681 req-9e25ec8f-2776-4b82-b3c5-7cd6fa2fea21 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 210 time: 0.0788171 Dec 20 06:03:31.653984 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-276ef197-3273-4b27-8d10-3072c389e603 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:31.655370 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-276ef197-3273-4b27-8d10-3072c389e603 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "GET /v2.0/networks?id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 HTTP/1.1" status: 200 len: 814 time: 0.1027787 Dec 20 06:03:31.676097 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-e7c409b8-37b5-4360-b7aa-51f4f1b2e8e1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Request body: {'port': {'device_id': 'a606d944-c589-452a-b51a-929526b88ef5', 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9', 'admin_state_up': True, 'tenant_id': '6c4d4d4e246d4f11a44ae2ec00c29b78'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:03:31.723457 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-992e077d-5bbf-4335-90df-6d13941bd818 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:31.800471 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-e7c409b8-37b5-4360-b7aa-51f4f1b2e8e1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Made reservation on behalf of 6c4d4d4e246d4f11a44ae2ec00c29b78 for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 06:03:31.803941 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-e7c409b8-37b5-4360-b7aa-51f4f1b2e8e1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:31.819981 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-65ea038e-f974-4257-8677-f859d6fb145a req-67071cb7-8140-4fc2-95b0-976a96ddf2a1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 210 time: 0.0314820 Dec 20 06:03:31.942528 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-e7c409b8-37b5-4360-b7aa-51f4f1b2e8e1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Allocated IP 172.20.0.10 (fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9/2bcf78d9-c760-46c0-85ca-57868ab46b20/40756b7d-f349-4d4a-b6e9-cc33ae0f461e) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 06:03:32.087690 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-e7c409b8-37b5-4360-b7aa-51f4f1b2e8e1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:32.119029 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-e7c409b8-37b5-4360-b7aa-51f4f1b2e8e1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:32.161881 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-e7c409b8-37b5-4360-b7aa-51f4f1b2e8e1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 06:03:32.165084 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-e7c409b8-37b5-4360-b7aa-51f4f1b2e8e1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 06:03:32.168580 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-e7c409b8-37b5-4360-b7aa-51f4f1b2e8e1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 06:03:32.194778 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7c409b8-37b5-4360-b7aa-51f4f1b2e8e1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Pushing event updated for resources: {'Port': ['ID=40756b7d-f349-4d4a-b6e9-cc33ae0f461e,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:32.220458 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-e7c409b8-37b5-4360-b7aa-51f4f1b2e8e1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:32.221066 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-e7c409b8-37b5-4360-b7aa-51f4f1b2e8e1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:32.236420 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-e7c409b8-37b5-4360-b7aa-51f4f1b2e8e1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5649390 Dec 20 06:03:32.255287 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Request body: {'port': {'device_id': 'a606d944-c589-452a-b51a-929526b88ef5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:03:32.313119 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:32.565879 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 40756b7d-f349-4d4a-b6e9-cc33ae0f461e {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:03:32.573099 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:32.584864 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Transition to ACTIVE for port object 40756b7d-f349-4d4a-b6e9-cc33ae0f461e will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 06:03:32.588737 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:32.638561 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Pushing event updated for resources: {'Port': ['ID=40756b7d-f349-4d4a-b6e9-cc33ae0f461e,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:32.703285 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Attempting to bind port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 06:03:32.704008 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Attempting to bind port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 06:03:32.704008 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Attempting to bind port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e on network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 06:03:32.708138 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e on network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 06:03:32.708450 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Attempting to bind port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e on network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 06:03:32.713081 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 6, 3, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 06:03:32.713411 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Checking segment: {'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 06:03:32.713783 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Bound using segment: {'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 06:03:32.714197 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Bound port: 40756b7d-f349-4d4a-b6e9-cc33ae0f461e, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 06:03:32.714534 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:32.773509 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] For port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 06:03:32.776385 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] For port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=40756b7d-f349-4d4a-b6e9-cc33ae0f461e,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 06:03:32.781106 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:32.815751 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:32.816417 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:32.817720 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] 10.222.0.54 "PUT /v2.0/ports/40756b7d-f349-4d4a-b6e9-cc33ae0f461e HTTP/1.1" status: 200 len: 1094 time: 0.5664263 Dec 20 06:03:32.818153 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a606d944-c589-452a-b51a-929526b88ef5', 'tag': '40756b7d-f349-4d4a-b6e9-cc33ae0f461e'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:03:32.820379 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c0f8ddd-6f5f-4303-9049-eb03834cab55" -d '{"events": [{"name": "network-changed", "server_uuid": "a606d944-c589-452a-b51a-929526b88ef5", "tag": "40756b7d-f349-4d4a-b6e9-cc33ae0f461e"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:03:32.844635 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c0536a3-e33e-4a5c-8d00-22705f8d9718 service neutron] Pushing event updated for resources: {'Port': ['ID=40756b7d-f349-4d4a-b6e9-cc33ae0f461e,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:32.865777 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 06:03:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d798640b-1641-4dfb-8c1a-7d952d2042d9 x-openstack-request-id: req-d798640b-1641-4dfb-8c1a-7d952d2042d9 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:03:32.866069 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a606d944-c589-452a-b51a-929526b88ef5", "tag": "40756b7d-f349-4d4a-b6e9-cc33ae0f461e", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:03:32.867065 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-d798640b-1641-4dfb-8c1a-7d952d2042d9 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:03:32.867464 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a606d944-c589-452a-b51a-929526b88ef5', 'tag': '40756b7d-f349-4d4a-b6e9-cc33ae0f461e', 'status': 'completed', 'code': 200} Dec 20 06:03:32.954876 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-2a371be3-89f0-4f89-b939-ac6705aea61a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:32.956390 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-2a371be3-89f0-4f89-b939-ac6705aea61a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6c4d4d4e246d4f11a44ae2ec00c29b78&device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 1097 time: 0.0716002 Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.961679 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.965125 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.965125 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.965125 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.965125 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.965125 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.965125 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.965125 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.965125 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.965125 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.965125 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.965125 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:32.965125 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:32.965125 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65677f0a-46e0-45f0-aa6b-452a28db3873 req-9ea8be12-eed6-49ca-a5db-e4cae57c0d3f tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:32.966158 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-65677f0a-46e0-45f0-aa6b-452a28db3873 req-9ea8be12-eed6-49ca-a5db-e4cae57c0d3f tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 944 time: 0.0718045 Dec 20 06:03:33.016387 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-73956a11-5a93-45c9-8b21-a9e43ef7ccbb service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=40756b7d-f349-4d4a-b6e9-cc33ae0f461e HTTP/1.1" status: 200 len: 217 time: 0.0437248 Dec 20 06:03:33.075373 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-65677f0a-46e0-45f0-aa6b-452a28db3873 req-2d0518dd-c3f5-4779-b76c-f5bf3375d6ee tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1036890 Dec 20 06:03:33.082303 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-ea1444a6-dad1-46b4-9b0f-4c686e0fa7d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:33.083682 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-ea1444a6-dad1-46b4-9b0f-4c686e0fa7d8 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2bcf78d9-c760-46c0-85ca-57868ab46b20 HTTP/1.1" status: 200 len: 854 time: 0.0574417 Dec 20 06:03:33.114735 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-28243111-8aa3-483f-9efa-fd22312e9284 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0235584 Dec 20 06:03:33.199335 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-87e771fc-b56f-4fee-9697-fe5f1d3fb736 service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0776722 Dec 20 06:03:33.288429 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-46356840-2b85-40fa-b7fc-cbf000e51883 req-df6c6fff-6c12-424a-9157-4e70ef5acedd service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824857 Dec 20 06:03:33.428112 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c0f8ddd-6f5f-4303-9049-eb03834cab55 req-015c255d-b4ff-4499-930a-abfb2ad847d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:33.429593 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7c0f8ddd-6f5f-4303-9049-eb03834cab55 req-015c255d-b4ff-4499-930a-abfb2ad847d9 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6c4d4d4e246d4f11a44ae2ec00c29b78&device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 1097 time: 0.0421090 Dec 20 06:03:33.526661 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c0f8ddd-6f5f-4303-9049-eb03834cab55 req-2eb2635b-eb59-4529-9f01-124e3ee011b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:33.528774 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7c0f8ddd-6f5f-4303-9049-eb03834cab55 req-2eb2635b-eb59-4529-9f01-124e3ee011b1 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 HTTP/1.1" status: 200 len: 915 time: 0.0913150 Dec 20 06:03:33.571787 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7c0f8ddd-6f5f-4303-9049-eb03834cab55 req-d3b06898-92e6-4ee2-bbf6-7cbf6ea72434 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=40756b7d-f349-4d4a-b6e9-cc33ae0f461e HTTP/1.1" status: 200 len: 217 time: 0.0346498 Dec 20 06:03:33.619203 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c0f8ddd-6f5f-4303-9049-eb03834cab55 req-6ded52bf-646a-4827-974e-2cb76592e227 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:33.621082 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7c0f8ddd-6f5f-4303-9049-eb03834cab55 req-6ded52bf-646a-4827-974e-2cb76592e227 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2bcf78d9-c760-46c0-85ca-57868ab46b20 HTTP/1.1" status: 200 len: 854 time: 0.0411289 Dec 20 06:03:33.655590 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7c0f8ddd-6f5f-4303-9049-eb03834cab55 req-0164a1ce-cdb6-4ef5-9426-fe3d6d6be731 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0268447 Dec 20 06:03:33.745165 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7c0f8ddd-6f5f-4303-9049-eb03834cab55 req-62fa2a9f-9915-4db7-a649-c3d2f9fa1f94 service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810475 Dec 20 06:03:33.838225 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7c0f8ddd-6f5f-4303-9049-eb03834cab55 req-cc826e9d-7c88-47d2-8ac6-c50f6953046d service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854082 Dec 20 06:03:34.163905 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-deca5bf4-4e4b-4730-8e00-97b3fb99d0cc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:34.190049 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d5d9ca-c2b6-4362-a6bb-ff83250c3879 req-8c3dba38-cb7a-4af9-a702-2c9a313cabf2 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:34.191530 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-04d5d9ca-c2b6-4362-a6bb-ff83250c3879 req-8c3dba38-cb7a-4af9-a702-2c9a313cabf2 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 944 time: 0.0484016 Dec 20 06:03:34.237535 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-04d5d9ca-c2b6-4362-a6bb-ff83250c3879 req-23de49c3-16ad-44cd-bed9-c99a778cad51 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398600 Dec 20 06:03:35.007069 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:35.348340 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddddd6ce-c674-4e95-9e3e-18bc4d5db8ab req-cf96b07f-c218-4bec-afa1-cc8b453a717b tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:35.349797 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ddddd6ce-c674-4e95-9e3e-18bc4d5db8ab req-cf96b07f-c218-4bec-afa1-cc8b453a717b tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 944 time: 0.0464845 Dec 20 06:03:35.398633 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ddddd6ce-c674-4e95-9e3e-18bc4d5db8ab req-6b0e7a75-4e69-4522-9981-3afb5f4713b5 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430367 Dec 20 06:03:36.504117 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:36.512525 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e80849a4-38ef-4818-94d4-3ea8386b0a6e req-77c106ce-a41f-42ba-b7af-775d52dbfa7f tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:36.514030 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e80849a4-38ef-4818-94d4-3ea8386b0a6e req-77c106ce-a41f-42ba-b7af-775d52dbfa7f tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 944 time: 0.0497372 Dec 20 06:03:36.562158 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e80849a4-38ef-4818-94d4-3ea8386b0a6e req-8de4f134-ceab-47c8-9c3b-532e26f0b4bd tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421090 Dec 20 06:03:37.576168 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:37.598861 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 40756b7d-f349-4d4a-b6e9-cc33ae0f461e details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 06:03:37.693609 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed02e3b2-a33e-4923-b88a-b43f530cad3e req-6864862e-18d5-4aea-ada6-aee4eba1072c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:37.695246 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ed02e3b2-a33e-4923-b88a-b43f530cad3e req-6864862e-18d5-4aea-ada6-aee4eba1072c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 944 time: 0.0678453 Dec 20 06:03:37.701688 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=40756b7d-f349-4d4a-b6e9-cc33ae0f461e,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:03:37.714379 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '40756b7d-f349-4d4a-b6e9-cc33ae0f461e', 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9', 'port_id': '40756b7d-f349-4d4a-b6e9-cc33ae0f461e', 'mac_address': 'fa:16:3e:f0:d2:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 402, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2bcf78d9-c760-46c0-85ca-57868ab46b20', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 06:03:37.753608 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:37.757311 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ed02e3b2-a33e-4923-b88a-b43f530cad3e req-192d3a3a-fff4-49ae-897b-1a15be0ad23e tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458856 Dec 20 06:03:37.778582 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 40756b7d-f349-4d4a-b6e9-cc33ae0f461e {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:03:37.790189 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=40756b7d-f349-4d4a-b6e9-cc33ae0f461e,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:03:37.794499 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:37.842498 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=40756b7d-f349-4d4a-b6e9-cc33ae0f461e,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:37.849190 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:37.849541 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:37.849884 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:37.850227 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:37.850557 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:37.850878 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:37.851200 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:37.851733 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:37.852270 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:37.852580 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:37.852903 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:37.853223 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:37.853564 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:03:38.082194 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['40756b7d-f349-4d4a-b6e9-cc33ae0f461e'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:03:38.782556 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:38.876140 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb694720-4de3-4ac0-8edf-4d9446f12a03 req-566a3230-8038-44f6-83af-9c1fe8c56a46 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:38.877578 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cb694720-4de3-4ac0-8edf-4d9446f12a03 req-566a3230-8038-44f6-83af-9c1fe8c56a46 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 945 time: 0.0511558 Dec 20 06:03:38.923299 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cb694720-4de3-4ac0-8edf-4d9446f12a03 req-745eea16-f637-49a2-85dc-b6b8ffe2468e tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399759 Dec 20 06:03:39.599454 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 40756b7d-f349-4d4a-b6e9-cc33ae0f461e up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 06:03:39.655776 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 06:03:39.659251 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 06:03:39.659653 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:39.740636 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:39.767689 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a606d944-c589-452a-b51a-929526b88ef5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '40756b7d-f349-4d4a-b6e9-cc33ae0f461e'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:03:39.769922 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-88c380a3-7382-4996-af12-832141dbc383" -d '{"events": [{"server_uuid": "a606d944-c589-452a-b51a-929526b88ef5", "name": "network-vif-plugged", "status": "completed", "tag": "40756b7d-f349-4d4a-b6e9-cc33ae0f461e"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:03:39.782686 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=40756b7d-f349-4d4a-b6e9-cc33ae0f461e,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:03:39.787030 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:39.810316 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:03:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-05a7c20e-0da0-4b84-8bdb-00a41e5f67bb x-openstack-request-id: req-05a7c20e-0da0-4b84-8bdb-00a41e5f67bb {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:03:39.810615 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a606d944-c589-452a-b51a-929526b88ef5", "name": "network-vif-plugged", "status": "completed", "tag": "40756b7d-f349-4d4a-b6e9-cc33ae0f461e", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:03:39.810871 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-05a7c20e-0da0-4b84-8bdb-00a41e5f67bb {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:03:39.811267 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a606d944-c589-452a-b51a-929526b88ef5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '40756b7d-f349-4d4a-b6e9-cc33ae0f461e', 'code': 200} Dec 20 06:03:39.835241 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=40756b7d-f349-4d4a-b6e9-cc33ae0f461e,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:40.067333 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da161fa9-6a7b-428e-83ca-3c849d71fe79 req-2a358970-bbd3-4e7f-83f2-5f597a1aea14 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:40.068867 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-da161fa9-6a7b-428e-83ca-3c849d71fe79 req-2a358970-bbd3-4e7f-83f2-5f597a1aea14 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 946 time: 0.0784953 Dec 20 06:03:40.085123 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4951c180-dbfb-4c3a-a746-ce24c53f4980 req-06ddb41e-fa9e-4d12-9bb3-0ea70fbb1fc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:40.085123 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4951c180-dbfb-4c3a-a746-ce24c53f4980 req-06ddb41e-fa9e-4d12-9bb3-0ea70fbb1fc2 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 1099 time: 0.1040049 Dec 20 06:03:40.154378 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-da161fa9-6a7b-428e-83ca-3c849d71fe79 req-8da0e721-508a-40c0-918b-ed1b1f23c8dd tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700960 Dec 20 06:03:40.156506 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4951c180-dbfb-4c3a-a746-ce24c53f4980 req-1e74f6ea-1035-415e-8fad-10082c9dab08 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651720 Dec 20 06:03:41.267683 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51ec7a31-a044-4e8d-815b-f070d6b7242b req-b47d637c-58fc-405b-8054-fa9acd2e9f83 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:41.269163 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-51ec7a31-a044-4e8d-815b-f070d6b7242b req-b47d637c-58fc-405b-8054-fa9acd2e9f83 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 946 time: 0.0482912 Dec 20 06:03:41.315226 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-51ec7a31-a044-4e8d-815b-f070d6b7242b req-27006f65-d182-4b18-a61e-a8b1a417a688 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403352 Dec 20 06:03:41.373693 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-8f7b486b-a040-4f5d-9225-ea1f268218ea tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-487768033&fields=id&tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb HTTP/1.1" status: 200 len: 267 time: 0.0419109 Dec 20 06:03:41.481189 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-1c8a5928-4f7f-4803-bf6d-dbc0fda4920a tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:41.482616 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-1c8a5928-4f7f-4803-bf6d-dbc0fda4920a tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 812 time: 0.1024077 Dec 20 06:03:41.496762 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-bf734312-7549-48ed-9383-0f83ebb5cc86 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/quotas/1aefc80d27d3426daae57e2b0a4cbbbb HTTP/1.1" status: 200 len: 375 time: 0.0084927 Dec 20 06:03:41.549272 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-8f0f19dc-98fb-4eb1-8754-ec2f282f982f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0472822 Dec 20 06:03:41.565213 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5fc54604-7e70-4eac-b8bc-7990034c8a7f service neutron] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 06:03:41.566147 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5fc54604-7e70-4eac-b8bc-7990034c8a7f service neutron] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048292 Dec 20 06:03:41.888105 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-df2b74f8-3661-4841-8e51-53373c0a57f6 service neutron] 10.222.0.46 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3164718 Dec 20 06:03:41.974667 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-85e60b47-c208-461a-9358-3bba6e0c2e94 service neutron] 10.222.0.46 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806010 Dec 20 06:03:42.246853 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-da3b3d8a-225b-4bc0-b768-6ce20b67dee4 req-9fb1ec42-cbb8-4e8e-a7b0-e5feefb57e21 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 210 time: 0.0256152 Dec 20 06:03:42.440817 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ab163e-3470-43d7-80ad-b948a29c0e7b req-ab056abd-d439-43d5-88ba-8cdeb95d041f tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:42.442377 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-33ab163e-3470-43d7-80ad-b948a29c0e7b req-ab056abd-d439-43d5-88ba-8cdeb95d041f tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 946 time: 0.0556848 Dec 20 06:03:42.490399 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-33ab163e-3470-43d7-80ad-b948a29c0e7b req-27596a48-fb8b-4391-81ba-12d2261b852c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416949 Dec 20 06:03:43.285357 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-7a2d096c-2a7f-4e0b-8538-87fbaeb434de tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:43.286865 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-7a2d096c-2a7f-4e0b-8538-87fbaeb434de tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 812 time: 0.1023843 Dec 20 06:03:43.347405 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-98a02af6-12a4-40a4-bba1-249e85296022 req-0cd17808-18de-47f4-bef0-1a5dbca9cd76 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 210 time: 0.0290325 Dec 20 06:03:43.383049 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-93ec797b-04a0-4f78-93cc-7afa36839e6a tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb HTTP/1.1" status: 200 len: 379 time: 0.0806839 Dec 20 06:03:43.392055 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-006bbb08-595a-4149-98ae-2bdb22bd68da tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Request body: {'port': {'device_id': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'admin_state_up': True, 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'security_groups': ['9e3980a1-6cf9-4277-a78d-dd743d8d3bde']}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:03:43.499457 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-006bbb08-595a-4149-98ae-2bdb22bd68da tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Made reservation on behalf of 1aefc80d27d3426daae57e2b0a4cbbbb for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 06:03:43.502940 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-006bbb08-595a-4149-98ae-2bdb22bd68da tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:43.624921 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-006bbb08-595a-4149-98ae-2bdb22bd68da tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Allocated IP 172.20.0.9 (ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6/41d28c9a-6c88-4c21-87ff-6f5f781d2b3e/6a3065b0-1f00-49dc-933d-3e0103b8afa7) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 06:03:43.762597 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-006bbb08-595a-4149-98ae-2bdb22bd68da tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:43.795527 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-006bbb08-595a-4149-98ae-2bdb22bd68da tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:43.852700 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-006bbb08-595a-4149-98ae-2bdb22bd68da tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 06:03:43.856481 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-006bbb08-595a-4149-98ae-2bdb22bd68da tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 06:03:43.861027 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-006bbb08-595a-4149-98ae-2bdb22bd68da tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 06:03:43.865127 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-006bbb08-595a-4149-98ae-2bdb22bd68da tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'Port': ['ID=6a3065b0-1f00-49dc-933d-3e0103b8afa7,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:43.914597 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-006bbb08-595a-4149-98ae-2bdb22bd68da tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:43.915313 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-006bbb08-595a-4149-98ae-2bdb22bd68da tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:43.936673 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-006bbb08-595a-4149-98ae-2bdb22bd68da tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5482578 Dec 20 06:03:43.950077 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-ba96ce8d-5b1f-46cc-a932-b429ec112704 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 06:03:43.951913 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-ba96ce8d-5b1f-46cc-a932-b429ec112704 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0077522 Dec 20 06:03:43.973103 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Request body: {'port': {'device_id': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:03:44.047815 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:44.160512 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-1a49f6fb-b9d0-4c68-86ac-18354cb58388 None None] Provisioning complete for port 6a3065b0-1f00-49dc-933d-3e0103b8afa7 triggered by entity DHCP. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 06:03:44.161092 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-1a49f6fb-b9d0-4c68-86ac-18354cb58388 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:44.198728 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-1a49f6fb-b9d0-4c68-86ac-18354cb58388 None None] Port 6a3065b0-1f00-49dc-933d-3e0103b8afa7 cannot update to ACTIVE because it is not bound. {{(pid=102447) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 20 06:03:44.318096 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6a3065b0-1f00-49dc-933d-3e0103b8afa7 {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:03:44.326802 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:44.339734 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Transition to ACTIVE for port object 6a3065b0-1f00-49dc-933d-3e0103b8afa7 will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 06:03:44.344247 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:44.404881 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-fae10a55-5f5b-4d0d-b4a0-eb9c91c4fab5 req-7abe099a-239c-45cf-af0e-dae460123939 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0703881 Dec 20 06:03:44.407655 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Pushing event updated for resources: {'Port': ['ID=6a3065b0-1f00-49dc-933d-3e0103b8afa7,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:44.485303 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae10a55-5f5b-4d0d-b4a0-eb9c91c4fab5 req-d9bbd3ad-8d19-437c-b525-ccc932501053 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:44.487134 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-fae10a55-5f5b-4d0d-b4a0-eb9c91c4fab5 req-d9bbd3ad-8d19-437c-b525-ccc932501053 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 1099 time: 0.0468056 Dec 20 06:03:44.510915 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Attempting to bind port 6a3065b0-1f00-49dc-933d-3e0103b8afa7 on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 06:03:44.511577 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Attempting to bind port 6a3065b0-1f00-49dc-933d-3e0103b8afa7 by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 06:03:44.511699 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Attempting to bind port 6a3065b0-1f00-49dc-933d-3e0103b8afa7 on network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 06:03:44.524401 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-957fd847-cc0e-4f82-8f3f-3a822719776a req-23e5e23b-47f9-4ea2-900b-14cbfa1ee501 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:44.527980 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-957fd847-cc0e-4f82-8f3f-3a822719776a req-23e5e23b-47f9-4ea2-900b-14cbfa1ee501 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 943 time: 0.0767019 Dec 20 06:03:44.529807 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Port 6a3065b0-1f00-49dc-933d-3e0103b8afa7 on network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 06:03:44.530141 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Attempting to bind port 6a3065b0-1f00-49dc-933d-3e0103b8afa7 on network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 06:03:44.543876 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 6, 3, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 06:03:44.544214 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Checking segment: {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 06:03:44.544598 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Bound using segment: {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 06:03:44.545049 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Bound port: 6a3065b0-1f00-49dc-933d-3e0103b8afa7, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '843466c5-3ffc-45e2-aa9c-b62cf8d89afd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 448, 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 06:03:44.545402 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:44.602371 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae10a55-5f5b-4d0d-b4a0-eb9c91c4fab5 req-f980baf4-f179-41c8-9986-b515936486b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:44.603866 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-fae10a55-5f5b-4d0d-b4a0-eb9c91c4fab5 req-f980baf4-f179-41c8-9986-b515936486b7 service neutron] 10.222.0.54 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 913 time: 0.0949259 Dec 20 06:03:44.622027 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-957fd847-cc0e-4f82-8f3f-3a822719776a req-dbd468e8-18f6-4483-8d7d-16c6f86eb2d8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0882392 Dec 20 06:03:44.649069 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] For port 6a3065b0-1f00-49dc-933d-3e0103b8afa7, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 06:03:44.652142 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] For port 6a3065b0-1f00-49dc-933d-3e0103b8afa7, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=6a3065b0-1f00-49dc-933d-3e0103b8afa7,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 06:03:44.656185 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:44.671688 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-fae10a55-5f5b-4d0d-b4a0-eb9c91c4fab5 req-78c67d79-6881-4af7-bce1-5910fc6be642 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9ac5d62d-b561-4355-9ddf-44f7ab993939 HTTP/1.1" status: 200 len: 1002 time: 0.0603058 Dec 20 06:03:44.688716 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:44.689499 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:44.690893 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] 10.222.0.54 "PUT /v2.0/ports/6a3065b0-1f00-49dc-933d-3e0103b8afa7 HTTP/1.1" status: 200 len: 1093 time: 0.7230499 Dec 20 06:03:44.691328 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'tag': '6a3065b0-1f00-49dc-933d-3e0103b8afa7'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:03:44.693570 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f287b9ad-c06f-4b4a-af81-19c5fba0b09b" -d '{"events": [{"name": "network-changed", "server_uuid": "d1ac4eb3-87a6-4d00-93ce-1f463d54ba82", "tag": "6a3065b0-1f00-49dc-933d-3e0103b8afa7"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:03:44.725751 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d502218-63a1-4988-9b3e-2c533eaefd9e service neutron] Pushing event updated for resources: {'Port': ['ID=6a3065b0-1f00-49dc-933d-3e0103b8afa7,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:44.732347 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae10a55-5f5b-4d0d-b4a0-eb9c91c4fab5 req-5f6583b9-5681-4b3e-a1f2-8ddcd7c97856 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:44.735584 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-fae10a55-5f5b-4d0d-b4a0-eb9c91c4fab5 req-5f6583b9-5681-4b3e-a1f2-8ddcd7c97856 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e HTTP/1.1" status: 200 len: 851 time: 0.0554109 Dec 20 06:03:44.763936 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 06:03:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f2a7e347-30a5-4c8d-8c29-7a3878372ab6 x-openstack-request-id: req-f2a7e347-30a5-4c8d-8c29-7a3878372ab6 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:03:44.764315 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d1ac4eb3-87a6-4d00-93ce-1f463d54ba82", "tag": "6a3065b0-1f00-49dc-933d-3e0103b8afa7", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:03:44.764484 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-f2a7e347-30a5-4c8d-8c29-7a3878372ab6 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:03:44.764889 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'tag': '6a3065b0-1f00-49dc-933d-3e0103b8afa7', 'status': 'completed', 'code': 200} Dec 20 06:03:44.795678 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae10a55-5f5b-4d0d-b4a0-eb9c91c4fab5 req-a958da5b-4614-43e7-b164-94ca143ea0dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:44.797189 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-fae10a55-5f5b-4d0d-b4a0-eb9c91c4fab5 req-a958da5b-4614-43e7-b164-94ca143ea0dc service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0489092 Dec 20 06:03:44.826133 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-17a66231-f335-4429-b8cc-b62b253f52df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:44.828574 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-17a66231-f335-4429-b8cc-b62b253f52df service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 1096 time: 0.0463800 Dec 20 06:03:44.881470 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-0e4e2515-3359-4d9e-a9e9-557a9fdcd7b4 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6a3065b0-1f00-49dc-933d-3e0103b8afa7 HTTP/1.1" status: 200 len: 217 time: 0.0395546 Dec 20 06:03:44.898116 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-fae10a55-5f5b-4d0d-b4a0-eb9c91c4fab5 req-bd5c5182-ed39-4c83-bd97-3f71aacb8960 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0928929 Dec 20 06:03:44.931840 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-06419703-5e8d-44c3-adad-dfc6c68c8fdf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:44.933252 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-06419703-5e8d-44c3-adad-dfc6c68c8fdf service neutron] 10.222.0.54 "GET /v2.0/subnets?id=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e HTTP/1.1" status: 200 len: 851 time: 0.0446405 Dec 20 06:03:44.979290 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-4d78f6aa-c3ef-4c4e-bc73-fdd41ffd8274 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:44.981352 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-4d78f6aa-c3ef-4c4e-bc73-fdd41ffd8274 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0400224 Dec 20 06:03:44.989495 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-fae10a55-5f5b-4d0d-b4a0-eb9c91c4fab5 req-427e4c98-65b8-448c-a89d-4b29fb8786c7 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846820 Dec 20 06:03:45.071988 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-99bc5e8d-2e33-49a6-be6b-2d0fe55b89e3 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828972 Dec 20 06:03:45.159039 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0e0bc220-d94f-4de1-9093-1da9e6a2eabc req-f2adbfd2-8dcf-469b-8884-5db97329fbdb service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0794981 Dec 20 06:03:45.282883 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f287b9ad-c06f-4b4a-af81-19c5fba0b09b req-46d75857-0c27-43c4-aad8-aba3df18873a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:45.284401 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f287b9ad-c06f-4b4a-af81-19c5fba0b09b req-46d75857-0c27-43c4-aad8-aba3df18873a service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 1096 time: 0.0404627 Dec 20 06:03:45.374488 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f287b9ad-c06f-4b4a-af81-19c5fba0b09b req-e6e77291-7de4-48f6-92c9-90d12938e2ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:45.375929 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f287b9ad-c06f-4b4a-af81-19c5fba0b09b req-e6e77291-7de4-48f6-92c9-90d12938e2ce service neutron] 10.222.0.54 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 913 time: 0.0838079 Dec 20 06:03:45.418650 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f287b9ad-c06f-4b4a-af81-19c5fba0b09b req-f5630e7c-6c88-4b5b-8767-5e5fdac87170 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6a3065b0-1f00-49dc-933d-3e0103b8afa7 HTTP/1.1" status: 200 len: 217 time: 0.0349643 Dec 20 06:03:45.470816 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f287b9ad-c06f-4b4a-af81-19c5fba0b09b req-12bd6896-cc89-493c-b2f8-433b426ca093 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:45.472272 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f287b9ad-c06f-4b4a-af81-19c5fba0b09b req-12bd6896-cc89-493c-b2f8-433b426ca093 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e HTTP/1.1" status: 200 len: 851 time: 0.0459435 Dec 20 06:03:45.528191 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f287b9ad-c06f-4b4a-af81-19c5fba0b09b req-c6428c58-9e2e-4180-b771-d860d12a6fb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:45.529566 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f287b9ad-c06f-4b4a-af81-19c5fba0b09b req-c6428c58-9e2e-4180-b771-d860d12a6fb9 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0388713 Dec 20 06:03:45.620048 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f287b9ad-c06f-4b4a-af81-19c5fba0b09b req-f05e17e8-6a7c-42ab-97cc-f9d5adc3ba8f service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816083 Dec 20 06:03:45.739681 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f287b9ad-c06f-4b4a-af81-19c5fba0b09b req-115d53ff-0fe2-403a-b60a-4518cffed76e service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1082103 Dec 20 06:03:45.751118 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c994755-023f-4d39-b91c-e7a82cbd35c4 req-b621c736-fe9e-4ed6-a7bd-5d80b7aaebdc tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:45.752500 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6c994755-023f-4d39-b91c-e7a82cbd35c4 req-b621c736-fe9e-4ed6-a7bd-5d80b7aaebdc tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 943 time: 0.0616989 Dec 20 06:03:45.803893 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6c994755-023f-4d39-b91c-e7a82cbd35c4 req-c621c0b4-0669-463d-8db9-fa08bad32adf tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450811 Dec 20 06:03:46.918540 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6162eafe-9efa-4c05-8ca3-bdfbb892b363 req-0fa81fe8-7881-41fd-ad23-58bf453e0ad4 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:46.920017 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6162eafe-9efa-4c05-8ca3-bdfbb892b363 req-0fa81fe8-7881-41fd-ad23-58bf453e0ad4 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 943 time: 0.0489144 Dec 20 06:03:46.968001 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-6162eafe-9efa-4c05-8ca3-bdfbb892b363 req-4c706908-aba7-4b3f-8ce2-d6c4efab9a4b tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421317 Dec 20 06:03:46.970070 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:03:48.080975 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c51f531-22b1-4110-a9ff-aac7e7e5ecf6 req-66cb2fc6-9e43-4933-82b4-93158dd3d9c1 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:48.082426 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7c51f531-22b1-4110-a9ff-aac7e7e5ecf6 req-66cb2fc6-9e43-4933-82b4-93158dd3d9c1 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 943 time: 0.0479398 Dec 20 06:03:48.128625 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7c51f531-22b1-4110-a9ff-aac7e7e5ecf6 req-daeb9322-8e42-404a-a088-ab4f1023ff66 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403857 Dec 20 06:03:49.244436 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2e2efc6-d929-4363-b095-49858f9f6ecf req-c707a0bc-f981-4f3b-9c52-42da4b441bed tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:49.245979 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b2e2efc6-d929-4363-b095-49858f9f6ecf req-c707a0bc-f981-4f3b-9c52-42da4b441bed tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 943 time: 0.0514071 Dec 20 06:03:49.294577 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b2e2efc6-d929-4363-b095-49858f9f6ecf req-e41044ed-207f-49d3-b347-8cab9e1713c8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420256 Dec 20 06:03:50.406275 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2cfac8b-eb6e-4b00-a85c-20b7293eaf98 req-44c8adb6-39c1-419e-bb6d-e667b92f8c26 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:50.407771 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f2cfac8b-eb6e-4b00-a85c-20b7293eaf98 req-44c8adb6-39c1-419e-bb6d-e667b92f8c26 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 943 time: 0.0479081 Dec 20 06:03:50.456810 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f2cfac8b-eb6e-4b00-a85c-20b7293eaf98 req-6173b882-6c70-43e3-bb18-3f8b30c11965 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430629 Dec 20 06:03:51.639304 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 6a3065b0-1f00-49dc-933d-3e0103b8afa7 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 06:03:51.726187 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06f5fd16-ebb1-4be1-8c32-2024c259ff6d req-102a4f6d-565e-4208-a219-b4e2a0046c91 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:51.727709 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-06f5fd16-ebb1-4be1-8c32-2024c259ff6d req-102a4f6d-565e-4208-a219-b4e2a0046c91 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 943 time: 0.0568430 Dec 20 06:03:51.742602 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 6a3065b0-1f00-49dc-933d-3e0103b8afa7, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=6a3065b0-1f00-49dc-933d-3e0103b8afa7,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:03:51.754637 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': '6a3065b0-1f00-49dc-933d-3e0103b8afa7', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'port_id': '6a3065b0-1f00-49dc-933d-3e0103b8afa7', 'mac_address': 'fa:16:3e:82:fc:30', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 448, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 06:03:51.796288 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:51.813852 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6a3065b0-1f00-49dc-933d-3e0103b8afa7 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:03:51.834176 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 6a3065b0-1f00-49dc-933d-3e0103b8afa7, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=6a3065b0-1f00-49dc-933d-3e0103b8afa7,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:03:51.839025 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:51.842572 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-06f5fd16-ebb1-4be1-8c32-2024c259ff6d req-c0de18af-39bf-47b6-b1a9-d20b7b3fc34f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1052916 Dec 20 06:03:51.868080 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-adea81bf-b073-4ac4-b0f1-e4fa015a20f8 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:51.869553 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-adea81bf-b073-4ac4-b0f1-e4fa015a20f8 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/networks?id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 HTTP/1.1" status: 200 len: 814 time: 0.1408422 Dec 20 06:03:51.885438 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-5f499a07-5952-4d57-b4af-33f4b911890e tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/quotas/6c4d4d4e246d4f11a44ae2ec00c29b78 HTTP/1.1" status: 200 len: 375 time: 0.0094573 Dec 20 06:03:51.887193 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=6a3065b0-1f00-49dc-933d-3e0103b8afa7,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:51.938177 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0f6360f5-c171-48e6-ba31-95dac3d83a85 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c4d4d4e246d4f11a44ae2ec00c29b78&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0462651 Dec 20 06:03:51.948459 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-2e6e6acc-ac15-4ebd-b4b3-f4f9d841046b service neutron] http://10.222.0.46:9696/v2.0/extensions returned with HTTP 200 {{(pid=102445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 20 06:03:51.949426 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-2e6e6acc-ac15-4ebd-b4b3-f4f9d841046b service neutron] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0047340 Dec 20 06:03:52.037047 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-8cb953d3-cc9a-453f-b358-6012b39491d9 service neutron] 10.222.0.46 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816154 Dec 20 06:03:52.136540 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-184b21db-c1a6-493b-863a-3d3afe00d1d2 service neutron] 10.222.0.46 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916221 Dec 20 06:03:52.191595 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['6a3065b0-1f00-49dc-933d-3e0103b8afa7'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:03:52.303316 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5a6af182-0cf9-490c-9906-658dbdbf8048 req-13454fea-3f68-4f4f-a7bc-64aa1c943c5d tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 210 time: 0.0271747 Dec 20 06:03:52.957752 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1753d639-edf6-4a45-a962-edc80d4fe284 req-9e370722-fcb1-4ffc-9859-90e272c090d8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:52.959239 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1753d639-edf6-4a45-a962-edc80d4fe284 req-9e370722-fcb1-4ffc-9859-90e272c090d8 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 944 time: 0.0471034 Dec 20 06:03:53.008590 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1753d639-edf6-4a45-a962-edc80d4fe284 req-ad372c40-cd33-4e37-b8d1-e389af5ea188 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421736 Dec 20 06:03:53.396683 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-e7293817-a521-4b8f-b090-80a857742ea9 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:53.398141 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-e7293817-a521-4b8f-b090-80a857742ea9 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "GET /v2.0/networks?id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 HTTP/1.1" status: 200 len: 814 time: 0.1205966 Dec 20 06:03:53.412402 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4170765b-a4b2-4e2f-960c-b63e3ef52e0e req-1cadd6fe-7dad-4537-8d0b-83a1e4e925b8 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 210 time: 0.0421817 Dec 20 06:03:53.428696 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-1de7a022-360c-421a-9be7-d82d2940dc8c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Request body: {'port': {'device_id': '9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c', 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9', 'admin_state_up': True, 'tenant_id': '6c4d4d4e246d4f11a44ae2ec00c29b78'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:03:53.538390 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-1de7a022-360c-421a-9be7-d82d2940dc8c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Made reservation on behalf of 6c4d4d4e246d4f11a44ae2ec00c29b78 for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 06:03:53.541786 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-1de7a022-360c-421a-9be7-d82d2940dc8c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:53.649448 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 6a3065b0-1f00-49dc-933d-3e0103b8afa7 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 06:03:53.659023 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-1de7a022-360c-421a-9be7-d82d2940dc8c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Allocated IP 172.20.0.8 (fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9/2bcf78d9-c760-46c0-85ca-57868ab46b20/a7974ee0-cb36-4f67-b838-34a1f138ec4a) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 06:03:53.704355 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port 6a3065b0-1f00-49dc-933d-3e0103b8afa7 completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 06:03:53.709480 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port 6a3065b0-1f00-49dc-933d-3e0103b8afa7 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 06:03:53.709855 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:53.788305 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:53.805202 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-1de7a022-360c-421a-9be7-d82d2940dc8c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:53.811206 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6a3065b0-1f00-49dc-933d-3e0103b8afa7'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:03:53.813467 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c95e33d3-31b5-4cbf-af15-7ebe55b0d055" -d '{"events": [{"server_uuid": "d1ac4eb3-87a6-4d00-93ce-1f463d54ba82", "name": "network-vif-plugged", "status": "completed", "tag": "6a3065b0-1f00-49dc-933d-3e0103b8afa7"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:03:53.825810 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port 6a3065b0-1f00-49dc-933d-3e0103b8afa7, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=6a3065b0-1f00-49dc-933d-3e0103b8afa7,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:03:53.831140 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:53.839381 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-1de7a022-360c-421a-9be7-d82d2940dc8c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:53.856895 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:03:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47578b65-f4b6-450e-a8a2-b235eaeb6918 x-openstack-request-id: req-47578b65-f4b6-450e-a8a2-b235eaeb6918 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:03:53.857188 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d1ac4eb3-87a6-4d00-93ce-1f463d54ba82", "name": "network-vif-plugged", "status": "completed", "tag": "6a3065b0-1f00-49dc-933d-3e0103b8afa7", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:03:53.857443 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-47578b65-f4b6-450e-a8a2-b235eaeb6918 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:03:53.857833 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6a3065b0-1f00-49dc-933d-3e0103b8afa7', 'code': 200} Dec 20 06:03:53.875771 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['40756b7d-f349-4d4a-b6e9-cc33ae0f461e'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:03:53.885103 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-1de7a022-360c-421a-9be7-d82d2940dc8c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 06:03:53.888029 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-1de7a022-360c-421a-9be7-d82d2940dc8c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 06:03:53.891807 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-1de7a022-360c-421a-9be7-d82d2940dc8c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 06:03:53.898092 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1de7a022-360c-421a-9be7-d82d2940dc8c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Pushing event updated for resources: {'Port': ['ID=a7974ee0-cb36-4f67-b838-34a1f138ec4a,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:53.908465 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=6a3065b0-1f00-49dc-933d-3e0103b8afa7,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:53.946990 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-1de7a022-360c-421a-9be7-d82d2940dc8c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:53.947646 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-1de7a022-360c-421a-9be7-d82d2940dc8c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:53.963083 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-1de7a022-360c-421a-9be7-d82d2940dc8c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5381925 Dec 20 06:03:53.986032 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Request body: {'port': {'device_id': '9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:03:54.040685 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:54.142613 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d71872-f87a-470c-a1c5-6105c59b6850 req-be8dace7-ed4a-4849-a3e9-adb494b47695 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102446) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:54.144189 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-67d71872-f87a-470c-a1c5-6105c59b6850 req-be8dace7-ed4a-4849-a3e9-adb494b47695 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 1098 time: 0.0403943 Dec 20 06:03:54.190881 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [req-67d71872-f87a-470c-a1c5-6105c59b6850 req-49333bbe-7298-4bb3-a94a-9cd60d8f5fa0 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392938 Dec 20 06:03:54.201269 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ffe57bc-0370-45f7-b0a7-b678a6858709 req-ac884574-58e3-4e19-ba81-9430f0d2f405 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:54.202954 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0ffe57bc-0370-45f7-b0a7-b678a6858709 req-ac884574-58e3-4e19-ba81-9430f0d2f405 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 945 time: 0.1189592 Dec 20 06:03:54.302498 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0ffe57bc-0370-45f7-b0a7-b678a6858709 req-8adaf3c4-e230-4789-807a-2d51ab2dd084 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0923185 Dec 20 06:03:54.372789 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a7974ee0-cb36-4f67-b838-34a1f138ec4a {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:03:54.379877 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:54.391937 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Transition to ACTIVE for port object a7974ee0-cb36-4f67-b838-34a1f138ec4a will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 06:03:54.395883 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:54.466142 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Pushing event updated for resources: {'Port': ['ID=a7974ee0-cb36-4f67-b838-34a1f138ec4a,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:54.545905 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Attempting to bind port a7974ee0-cb36-4f67-b838-34a1f138ec4a on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 06:03:54.546237 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Attempting to bind port a7974ee0-cb36-4f67-b838-34a1f138ec4a by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 06:03:54.546567 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Attempting to bind port a7974ee0-cb36-4f67-b838-34a1f138ec4a on network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.557426 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.560536 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.560536 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.560536 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.560536 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.560536 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.560536 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.560536 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.560536 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.560536 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.560536 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.560536 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:03:54.560536 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:03:54.564430 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a8dc8e5-ccb6-44ac-9cce-c93279d4ed1b req-dab7003d-35cc-4223-a001-f35863b35641 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:54.565913 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1a8dc8e5-ccb6-44ac-9cce-c93279d4ed1b req-dab7003d-35cc-4223-a001-f35863b35641 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 943 time: 0.0756736 Dec 20 06:03:54.566694 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Port a7974ee0-cb36-4f67-b838-34a1f138ec4a on network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 06:03:54.567015 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Attempting to bind port a7974ee0-cb36-4f67-b838-34a1f138ec4a on network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 06:03:54.573217 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 6, 3, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 06:03:54.573561 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Checking segment: {'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 06:03:54.573957 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Bound using segment: {'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 06:03:54.574382 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Bound port: a7974ee0-cb36-4f67-b838-34a1f138ec4a, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 06:03:54.574734 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:54.652719 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1a8dc8e5-ccb6-44ac-9cce-c93279d4ed1b req-5dc5c9f7-2936-483b-a08d-30e5fc9cbb53 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798762 Dec 20 06:03:54.668307 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] For port a7974ee0-cb36-4f67-b838-34a1f138ec4a, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 06:03:54.671312 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] For port a7974ee0-cb36-4f67-b838-34a1f138ec4a, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=a7974ee0-cb36-4f67-b838-34a1f138ec4a,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 06:03:54.675875 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:54.710037 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:54.710643 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:54.712030 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] 10.222.0.54 "PUT /v2.0/ports/a7974ee0-cb36-4f67-b838-34a1f138ec4a HTTP/1.1" status: 200 len: 1093 time: 0.7303400 Dec 20 06:03:54.712481 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c', 'tag': 'a7974ee0-cb36-4f67-b838-34a1f138ec4a'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:03:54.715239 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-991b8d5e-d08d-4e87-9105-7de624542543" -d '{"events": [{"name": "network-changed", "server_uuid": "9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c", "tag": "a7974ee0-cb36-4f67-b838-34a1f138ec4a"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:03:54.741561 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0517a8a7-050c-4118-a0bc-e4465cbc86cd service neutron] Pushing event updated for resources: {'Port': ['ID=a7974ee0-cb36-4f67-b838-34a1f138ec4a,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:54.750551 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 06:03:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f83067c-ea18-41a4-a20b-51b3dea4d68f x-openstack-request-id: req-7f83067c-ea18-41a4-a20b-51b3dea4d68f {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:03:54.750779 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c", "tag": "a7974ee0-cb36-4f67-b838-34a1f138ec4a", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:03:54.751030 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-7f83067c-ea18-41a4-a20b-51b3dea4d68f {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:03:54.751423 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c', 'tag': 'a7974ee0-cb36-4f67-b838-34a1f138ec4a', 'status': 'completed', 'code': 200} Dec 20 06:03:54.837022 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-d6fc3e56-40ae-4520-9b37-c0b90acd18eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:54.838441 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-d6fc3e56-40ae-4520-9b37-c0b90acd18eb service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6c4d4d4e246d4f11a44ae2ec00c29b78&device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 1096 time: 0.0388005 Dec 20 06:03:54.899425 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-9899b919-d1af-436a-a17c-612a8d42ee09 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=a7974ee0-cb36-4f67-b838-34a1f138ec4a HTTP/1.1" status: 200 len: 217 time: 0.0330687 Dec 20 06:03:54.960013 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-401dea12-8f3a-4cca-8405-2699fa7578cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:54.961314 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-401dea12-8f3a-4cca-8405-2699fa7578cc service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2bcf78d9-c760-46c0-85ca-57868ab46b20 HTTP/1.1" status: 200 len: 854 time: 0.0444148 Dec 20 06:03:54.996829 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-eb09d1e4-3a1e-4e3f-bd97-963f50a5b285 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0234950 Dec 20 06:03:55.084741 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-dd2e7829-41ac-46d6-8a4e-62dcfe58eba6 service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802255 Dec 20 06:03:55.179857 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-370b1d11-5984-45a9-b8be-b8c4ab77efee req-896a2a5b-63e9-4352-8cd0-4dd94f1189e4 service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839460 Dec 20 06:03:55.449818 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aecf8c7-7e4e-49b6-af4f-759073dbd3a8 req-75c34ca2-0f74-42a6-b519-6737f53740a6 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:55.451435 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7aecf8c7-7e4e-49b6-af4f-759073dbd3a8 req-75c34ca2-0f74-42a6-b519-6737f53740a6 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 945 time: 0.0842619 Dec 20 06:03:55.453459 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991b8d5e-d08d-4e87-9105-7de624542543 req-89134bec-499e-467c-aea5-0d817143e8bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:55.454877 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-991b8d5e-d08d-4e87-9105-7de624542543 req-89134bec-499e-467c-aea5-0d817143e8bf service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6c4d4d4e246d4f11a44ae2ec00c29b78&device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 1096 time: 0.0617793 Dec 20 06:03:55.591674 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-7aecf8c7-7e4e-49b6-af4f-759073dbd3a8 req-1557c315-7964-435f-89a4-99d269542900 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1339865 Dec 20 06:03:55.600576 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991b8d5e-d08d-4e87-9105-7de624542543 req-e5b2114f-0f9b-48ad-84f6-3794b156aaa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:55.601965 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-991b8d5e-d08d-4e87-9105-7de624542543 req-e5b2114f-0f9b-48ad-84f6-3794b156aaa8 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 HTTP/1.1" status: 200 len: 915 time: 0.1270545 Dec 20 06:03:55.650323 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-991b8d5e-d08d-4e87-9105-7de624542543 req-9fe3ea53-2307-48f2-b0c0-1a3931600cd7 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=a7974ee0-cb36-4f67-b838-34a1f138ec4a HTTP/1.1" status: 200 len: 217 time: 0.0394428 Dec 20 06:03:55.705675 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991b8d5e-d08d-4e87-9105-7de624542543 req-c0c4356c-8ad3-465d-af9d-991897517804 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:55.715700 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-991b8d5e-d08d-4e87-9105-7de624542543 req-c0c4356c-8ad3-465d-af9d-991897517804 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2bcf78d9-c760-46c0-85ca-57868ab46b20 HTTP/1.1" status: 200 len: 854 time: 0.0518029 Dec 20 06:03:55.772435 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-991b8d5e-d08d-4e87-9105-7de624542543 req-7fe28ba0-47fa-4079-a11d-5d49f0af1e8f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0429547 Dec 20 06:03:55.817627 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe424eb-86a2-4b89-a9d4-806b9cf87c4d req-bc447e37-f822-4190-af2f-334793f64c17 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:55.819066 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cbe424eb-86a2-4b89-a9d4-806b9cf87c4d req-bc447e37-f822-4190-af2f-334793f64c17 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 943 time: 0.0977230 Dec 20 06:03:55.905914 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-991b8d5e-d08d-4e87-9105-7de624542543 req-65673127-18a9-489b-ad24-2a70461f3833 service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1247249 Dec 20 06:03:55.909572 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cbe424eb-86a2-4b89-a9d4-806b9cf87c4d req-c0578afb-b2a4-4d3f-bd7d-40d5f1868709 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0610826 Dec 20 06:03:56.231936 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-991b8d5e-d08d-4e87-9105-7de624542543 req-dd798164-26d9-4069-b3d5-49682ac0502d service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3163621 Dec 20 06:03:56.704049 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58cfa440-7dd4-4df9-ad4e-bc3a32441a77 req-4f37acc9-2cd0-4ca5-9528-e92afbbfde22 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:56.705474 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58cfa440-7dd4-4df9-ad4e-bc3a32441a77 req-4f37acc9-2cd0-4ca5-9528-e92afbbfde22 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 945 time: 0.0475254 Dec 20 06:03:56.752203 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-58cfa440-7dd4-4df9-ad4e-bc3a32441a77 req-bdee35d1-83c9-48ed-b713-f29be1cc6b02 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409274 Dec 20 06:03:56.865572 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59177387-89a4-4f91-b6be-f23a9d80486a req-6a209a51-a9e5-48da-a754-95a5e8671909 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:56.867318 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-59177387-89a4-4f91-b6be-f23a9d80486a req-6a209a51-a9e5-48da-a754-95a5e8671909 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 945 time: 0.0495851 Dec 20 06:03:56.915922 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-59177387-89a4-4f91-b6be-f23a9d80486a req-7c0c2604-ed10-4056-a4f9-f9b424169324 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426259 Dec 20 06:03:56.939029 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 51094) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:03:56.982083 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eab21f60-8795-4e4b-8a0c-1a317af510ff tempest-TestVolumeBootPattern-384334718 tempest-TestVolumeBootPattern-384334718-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:56.983630 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-eab21f60-8795-4e4b-8a0c-1a317af510ff tempest-TestVolumeBootPattern-384334718 tempest-TestVolumeBootPattern-384334718-project-admin] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 1093 time: 0.0435264 Dec 20 06:03:56.986579 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 51096) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:03:56.991706 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.v2.base [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Request body: {'floatingip': {'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'port_id': '6a3065b0-1f00-49dc-933d-3e0103b8afa7', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address': '172.20.0.9'}} {{(pid=102446) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:03:57.017868 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for floatingip, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:57.035354 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-890ee760-e68d-463a-b7c0-abd2364aa577 req-f61b7e25-b06c-4a19-86a8-9361924be28c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:57.036866 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-890ee760-e68d-463a-b7c0-abd2364aa577 req-f61b7e25-b06c-4a19-86a8-9361924be28c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 943 time: 0.0522749 Dec 20 06:03:57.086445 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-890ee760-e68d-463a-b7c0-abd2364aa577 req-137a0f07-e923-4d0a-be8d-c88d75a3a4bc tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433757 Dec 20 06:03:57.130861 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:57.230908 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_common [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Allocated IP 172.27.3.236 (2e5c289b-6b36-4be8-98bd-7afaf0da3344/13c80048-1854-452a-96f1-f7b3d8117ba4/380619c5-15d2-403e-8d5f-10ba70ac693e) {{(pid=102446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 06:03:57.331626 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for port, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:57.363094 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:57.403297 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Network 2e5c289b-6b36-4be8-98bd-7afaf0da3344 is already hosted by enough agents. {{(pid=102446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 06:03:57.406027 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.base_scheduler [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Resources bound (agent type, host, resource id): {{(pid=102446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 06:03:57.408514 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Received port after_create {{(pid=102446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 06:03:57.433877 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'Port': ['ID=380619c5-15d2-403e-8d5f-10ba70ac693e,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:57.679177 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device a7974ee0-cb36-4f67-b838-34a1f138ec4a details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 06:03:57.778491 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port a7974ee0-cb36-4f67-b838-34a1f138ec4a, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=a7974ee0-cb36-4f67-b838-34a1f138ec4a,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:03:57.920763 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': 'a7974ee0-cb36-4f67-b838-34a1f138ec4a', 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9', 'port_id': 'a7974ee0-cb36-4f67-b838-34a1f138ec4a', 'mac_address': 'fa:16:3e:20:00:44', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 402, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2bcf78d9-c760-46c0-85ca-57868ab46b20', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 06:03:57.958779 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:57.972037 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a7974ee0-cb36-4f67-b838-34a1f138ec4a {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:03:57.992503 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port a7974ee0-cb36-4f67-b838-34a1f138ec4a, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=a7974ee0-cb36-4f67-b838-34a1f138ec4a,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:03:57.997698 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:58.021975 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:58.043220 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=a7974ee0-cb36-4f67-b838-34a1f138ec4a,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:58.086196 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:58.202106 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c1c27f-e0f2-400b-96c6-1a027fe23182 req-fd1f460b-17c4-404e-b787-f645eced5684 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:58.203590 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c5c1c27f-e0f2-400b-96c6-1a027fe23182 req-fd1f460b-17c4-404e-b787-f645eced5684 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 944 time: 0.0489554 Dec 20 06:03:58.234353 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for port, precommit_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:58.240159 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-9173306'] for port, after_update {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:58.251122 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c5c1c27f-e0f2-400b-96c6-1a027fe23182 req-3394adfe-eaaf-4bf7-8fb3-cc0280d2cd77 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414832 Dec 20 06:03:58.312724 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event updated for resources: {'Port': ['ID=380619c5-15d2-403e-8d5f-10ba70ac693e,revision_number=2']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:03:58.320534 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1703424'] for floatingip, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:58.342807 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['a7974ee0-cb36-4f67-b838-34a1f138ec4a'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:03:58.419578 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.l3_db [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Floating IP 9e9d2f80-f23b-467a-9e6e-eef565fe2cd8 associated. External IP: 172.27.3.236, port: 6a3065b0-1f00-49dc-933d-3e0103b8afa7. Dec 20 06:03:58.632161 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Router 8700450f-8a60-4f59-88d0-7c64696c2fae has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:03:58.735895 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:03:58.745701 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bb18db0-6a18-4fd7-be6d-23b661a2c579 None None] Sync routers for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:03:58.753392 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:58.756744 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bb18db0-6a18-4fd7-be6d-23b661a2c579 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:03:58.757433 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-6bb18db0-6a18-4fd7-be6d-23b661a2c579 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:03:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:58.787366 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-29c114ac-652c-4a42-9a35-f336c88c7044 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.7993259 Dec 20 06:03:58.788054 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'tag': '6a3065b0-1f00-49dc-933d-3e0103b8afa7'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:03:58.790270 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8971e1d1-741f-4f9f-a934-1b9a5ad3f934" -d '{"events": [{"name": "network-changed", "server_uuid": "d1ac4eb3-87a6-4d00-93ce-1f463d54ba82", "tag": "6a3065b0-1f00-49dc-933d-3e0103b8afa7"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:03:58.827307 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 06:03:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-80c404fb-9793-4018-b5c9-456d1a8ca499 x-openstack-request-id: req-80c404fb-9793-4018-b5c9-456d1a8ca499 {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:03:58.827626 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d1ac4eb3-87a6-4d00-93ce-1f463d54ba82", "tag": "6a3065b0-1f00-49dc-933d-3e0103b8afa7", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:03:58.827884 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-80c404fb-9793-4018-b5c9-456d1a8ca499 {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:03:58.828279 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'tag': '6a3065b0-1f00-49dc-933d-3e0103b8afa7', 'status': 'completed', 'code': 200} Dec 20 06:03:58.873487 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-6bb18db0-6a18-4fd7-be6d-23b661a2c579 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:03:58.913722 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8971e1d1-741f-4f9f-a934-1b9a5ad3f934 req-b073f0d3-8052-4f93-a67a-77f9bb6623aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:58.915129 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8971e1d1-741f-4f9f-a934-1b9a5ad3f934 req-b073f0d3-8052-4f93-a67a-77f9bb6623aa service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 1098 time: 0.0419488 Dec 20 06:03:59.004991 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8971e1d1-741f-4f9f-a934-1b9a5ad3f934 req-c453ba9b-f4e2-487c-b0b5-85eea0882917 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:59.006451 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8971e1d1-741f-4f9f-a934-1b9a5ad3f934 req-c453ba9b-f4e2-487c-b0b5-85eea0882917 service neutron] 10.222.0.54 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 913 time: 0.0825152 Dec 20 06:03:59.074909 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8971e1d1-741f-4f9f-a934-1b9a5ad3f934 req-43d3e00e-6ded-4ec7-bca7-5f3bce94de12 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6a3065b0-1f00-49dc-933d-3e0103b8afa7 HTTP/1.1" status: 200 len: 999 time: 0.0606775 Dec 20 06:03:59.099917 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-6bb18db0-6a18-4fd7-be6d-23b661a2c579 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '8084dafe-347a-4114-b271-db1f87312b55', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.129', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 642, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:37:2c:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:02:02Z', 'updated_at': '2021-12-20T06:02:04Z', 'revision_number': 1, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}, {'id': '9e9d2f80-f23b-467a-9e6e-eef565fe2cd8', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.236', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '6a3065b0-1f00-49dc-933d-3e0103b8afa7', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 655, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:82:fc:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:03:57Z', 'updated_at': '2021-12-20T06:03:57Z', 'revision_number': 0, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:59.122119 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8971e1d1-741f-4f9f-a934-1b9a5ad3f934 req-80e95923-06dd-4ab8-8e71-cc2ef5236cbe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:59.123558 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8971e1d1-741f-4f9f-a934-1b9a5ad3f934 req-80e95923-06dd-4ab8-8e71-cc2ef5236cbe service neutron] 10.222.0.54 "GET /v2.0/subnets?id=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e HTTP/1.1" status: 200 len: 851 time: 0.0416312 Dec 20 06:03:59.126356 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bb18db0-6a18-4fd7-be6d-23b661a2c579 None None] Checking router: 8700450f-8a60-4f59-88d0-7c64696c2fae for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:03:59.135056 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bb18db0-6a18-4fd7-be6d-23b661a2c579 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:03:59.135685 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-6bb18db0-6a18-4fd7-be6d-23b661a2c579 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:03:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:59.168126 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8971e1d1-741f-4f9f-a934-1b9a5ad3f934 req-d572aa64-28b7-4699-90d0-78af4d8a1540 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:59.169494 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8971e1d1-741f-4f9f-a934-1b9a5ad3f934 req-d572aa64-28b7-4699-90d0-78af4d8a1540 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0387077 Dec 20 06:03:59.244281 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-6bb18db0-6a18-4fd7-be6d-23b661a2c579 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:03:59.262175 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8971e1d1-741f-4f9f-a934-1b9a5ad3f934 req-8985eba2-53bc-4851-a5c9-cb3b36397d3f service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837312 Dec 20 06:03:59.382710 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8971e1d1-741f-4f9f-a934-1b9a5ad3f934 req-6e7e4e4e-e75f-42c2-bbb4-5a3b598d346e service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1134868 Dec 20 06:03:59.395075 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-240ec5bd-6f13-4c08-b914-b9dedb97771c req-484dc672-3757-4009-9c42-e0cc9a146ac4 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:03:59.396559 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-240ec5bd-6f13-4c08-b914-b9dedb97771c req-484dc672-3757-4009-9c42-e0cc9a146ac4 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 944 time: 0.0726013 Dec 20 06:03:59.448291 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-240ec5bd-6f13-4c08-b914-b9dedb97771c req-5f450eb6-2570-4245-b50d-39dd15f56938 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449827 Dec 20 06:03:59.473466 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-6bb18db0-6a18-4fd7-be6d-23b661a2c579 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '8084dafe-347a-4114-b271-db1f87312b55', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.129', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 642, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:37:2c:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:02:02Z', 'updated_at': '2021-12-20T06:02:04Z', 'revision_number': 1, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}, {'id': '9e9d2f80-f23b-467a-9e6e-eef565fe2cd8', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.236', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '6a3065b0-1f00-49dc-933d-3e0103b8afa7', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 655, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:82:fc:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:03:57Z', 'updated_at': '2021-12-20T06:03:57Z', 'revision_number': 0, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:03:59.500441 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bb18db0-6a18-4fd7-be6d-23b661a2c579 None None] The sync data for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi is: [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '8084dafe-347a-4114-b271-db1f87312b55', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.129', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 642, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:37:2c:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:02:02Z', 'updated_at': '2021-12-20T06:02:04Z', 'revision_number': 1, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}, {'id': '9e9d2f80-f23b-467a-9e6e-eef565fe2cd8', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.236', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '6a3065b0-1f00-49dc-933d-3e0103b8afa7', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 655, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:82:fc:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:03:57Z', 'updated_at': '2021-12-20T06:03:57Z', 'revision_number': 0, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:03:59.686975 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e62c8856-bbc8-46ee-8095-1904f6c7e873 None None] New status for floating IP 9e9d2f80-f23b-467a-9e6e-eef565fe2cd8: ACTIVE {{(pid=102448) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 06:03:59.696710 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device a7974ee0-cb36-4f67-b838-34a1f138ec4a up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 06:03:59.747038 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port a7974ee0-cb36-4f67-b838-34a1f138ec4a completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 06:03:59.751470 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port a7974ee0-cb36-4f67-b838-34a1f138ec4a triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 06:03:59.751870 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:59.832750 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:59.857508 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a7974ee0-cb36-4f67-b838-34a1f138ec4a'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:03:59.859901 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f159efd-fc42-48d9-9665-150a998e30b1" -d '{"events": [{"server_uuid": "9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c", "name": "network-vif-plugged", "status": "completed", "tag": "a7974ee0-cb36-4f67-b838-34a1f138ec4a"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:03:59.872935 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port a7974ee0-cb36-4f67-b838-34a1f138ec4a, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=a7974ee0-cb36-4f67-b838-34a1f138ec4a,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:03:59.876897 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:03:59.899739 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:03:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aeef7cfb-d7fe-496a-9b08-ca39e79488ba x-openstack-request-id: req-aeef7cfb-d7fe-496a-9b08-ca39e79488ba {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:03:59.900030 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c", "name": "network-vif-plugged", "status": "completed", "tag": "a7974ee0-cb36-4f67-b838-34a1f138ec4a", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:03:59.900279 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-aeef7cfb-d7fe-496a-9b08-ca39e79488ba {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:03:59.900662 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a7974ee0-cb36-4f67-b838-34a1f138ec4a', 'code': 200} Dec 20 06:03:59.925737 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=a7974ee0-cb36-4f67-b838-34a1f138ec4a,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:04:00.109633 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b0a5ab2-07ac-4175-8c9c-5808c9ddc15d req-06e9908a-bb81-4521-9aa6-8239fad2f12b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:00.111077 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4b0a5ab2-07ac-4175-8c9c-5808c9ddc15d req-06e9908a-bb81-4521-9aa6-8239fad2f12b service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 1098 time: 0.0394695 Dec 20 06:04:00.153841 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4b0a5ab2-07ac-4175-8c9c-5808c9ddc15d req-0157e47d-5eb2-4a0b-b03a-1cab26bdc303 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358694 Dec 20 06:04:00.564437 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7bf2e01-cd0f-439d-9caf-876611369083 req-d4e32c89-6a25-4e89-b620-7424c8f09d4a tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:00.565885 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b7bf2e01-cd0f-439d-9caf-876611369083 req-d4e32c89-6a25-4e89-b620-7424c8f09d4a tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 945 time: 0.0502634 Dec 20 06:04:00.611171 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b7bf2e01-cd0f-439d-9caf-876611369083 req-65a54d58-1e6f-4812-8dfb-d4c491ef7230 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395637 Dec 20 06:04:01.726237 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-e50595cd-e637-4527-9a8e-89c6ce846380 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:01.728304 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2e631b4-b060-4e28-8330-79833bc13320 req-29ef6acd-433e-4ca8-a40a-7c423ae487e0 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:01.729859 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c2e631b4-b060-4e28-8330-79833bc13320 req-29ef6acd-433e-4ca8-a40a-7c423ae487e0 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 945 time: 0.0497124 Dec 20 06:04:01.776334 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c2e631b4-b060-4e28-8330-79833bc13320 req-7151d595-a657-4274-830b-d63be3442004 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404596 Dec 20 06:04:03.458395 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-1c6e86c6-248d-4d80-a8c1-9f2eee90f88d tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:03.459818 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-1c6e86c6-248d-4d80-a8c1-9f2eee90f88d tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/networks?id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 HTTP/1.1" status: 200 len: 814 time: 0.1019106 Dec 20 06:04:03.474673 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-a5d1fcce-7b10-442a-8a7a-32db11f773c2 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/quotas/6c4d4d4e246d4f11a44ae2ec00c29b78 HTTP/1.1" status: 200 len: 375 time: 0.0087218 Dec 20 06:04:03.522888 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e6318f96-9854-414e-991c-c99f721e2c02 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c4d4d4e246d4f11a44ae2ec00c29b78&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0431895 Dec 20 06:04:03.612401 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-6c5eeebe-6b3e-42d3-afe7-8a7ae3c63176 service neutron] 10.222.0.46 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822210 Dec 20 06:04:03.698692 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-ecf611fd-8563-44b7-8f02-76664c6e6921 service neutron] 10.222.0.46 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0803931 Dec 20 06:04:03.851397 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9c91a51c-ef3f-4dd4-97cf-bdf3c09b3ea4 req-f84cd414-4a32-49ca-b5c0-d5de245c9dee tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 210 time: 0.0262167 Dec 20 06:04:04.165626 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-fd58796a-35fa-41f1-9e87-f04622b00aba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:04.876308 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-b13677f6-6fb5-4700-8aeb-df1ca4af6464 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:04.877860 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-b13677f6-6fb5-4700-8aeb-df1ca4af6464 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "GET /v2.0/networks?id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 HTTP/1.1" status: 200 len: 814 time: 0.1094432 Dec 20 06:04:04.910217 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-84c8f9ed-bd92-438f-ac8c-62c7831545bb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Request body: {'port': {'device_id': '47e7bff3-8129-47cb-8d1d-54ee4b98ea4b', 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9', 'admin_state_up': True, 'tenant_id': '6c4d4d4e246d4f11a44ae2ec00c29b78'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:04:04.965135 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0bf270c2-d106-43a8-922c-82883e7c2ee6 req-5df874ad-23f0-4fc4-950a-f18e52f720e2 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 210 time: 0.0381994 Dec 20 06:04:05.013180 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:05.056747 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-84c8f9ed-bd92-438f-ac8c-62c7831545bb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Made reservation on behalf of 6c4d4d4e246d4f11a44ae2ec00c29b78 for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 06:04:05.060662 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-84c8f9ed-bd92-438f-ac8c-62c7831545bb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:05.180131 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-84c8f9ed-bd92-438f-ac8c-62c7831545bb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Allocated IP 172.20.0.9 (fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9/2bcf78d9-c760-46c0-85ca-57868ab46b20/c7347d8a-ef46-470a-b201-f8e81c3e6789) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 06:04:05.322018 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-84c8f9ed-bd92-438f-ac8c-62c7831545bb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:05.353996 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-84c8f9ed-bd92-438f-ac8c-62c7831545bb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:05.393724 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['40756b7d-f349-4d4a-b6e9-cc33ae0f461e', 'a7974ee0-cb36-4f67-b838-34a1f138ec4a'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:04:05.400305 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-84c8f9ed-bd92-438f-ac8c-62c7831545bb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 06:04:05.403239 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-84c8f9ed-bd92-438f-ac8c-62c7831545bb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 06:04:05.406740 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-84c8f9ed-bd92-438f-ac8c-62c7831545bb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 06:04:05.413051 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84c8f9ed-bd92-438f-ac8c-62c7831545bb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Pushing event updated for resources: {'Port': ['ID=c7347d8a-ef46-470a-b201-f8e81c3e6789,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:04:05.457495 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-84c8f9ed-bd92-438f-ac8c-62c7831545bb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:05.458157 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-84c8f9ed-bd92-438f-ac8c-62c7831545bb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:05.473438 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-84c8f9ed-bd92-438f-ac8c-62c7831545bb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5676627 Dec 20 06:04:05.493265 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Request body: {'port': {'device_id': '47e7bff3-8129-47cb-8d1d-54ee4b98ea4b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:04:05.544004 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:05.795611 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c7347d8a-ef46-470a-b201-f8e81c3e6789 {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:04:05.802807 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:05.814231 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Transition to ACTIVE for port object c7347d8a-ef46-470a-b201-f8e81c3e6789 will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 06:04:05.818866 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:05.869910 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Pushing event updated for resources: {'Port': ['ID=c7347d8a-ef46-470a-b201-f8e81c3e6789,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:04:05.934497 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Attempting to bind port c7347d8a-ef46-470a-b201-f8e81c3e6789 on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 06:04:05.935160 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Attempting to bind port c7347d8a-ef46-470a-b201-f8e81c3e6789 by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 06:04:05.935160 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Attempting to bind port c7347d8a-ef46-470a-b201-f8e81c3e6789 on network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 06:04:05.939548 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Port c7347d8a-ef46-470a-b201-f8e81c3e6789 on network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 06:04:05.939908 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Attempting to bind port c7347d8a-ef46-470a-b201-f8e81c3e6789 on network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 06:04:05.944634 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 6, 3, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 06:04:05.944967 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Checking segment: {'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 06:04:05.945345 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Bound using segment: {'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 06:04:05.945766 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Bound port: c7347d8a-ef46-470a-b201-f8e81c3e6789, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 06:04:05.946134 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:06.007794 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] For port c7347d8a-ef46-470a-b201-f8e81c3e6789, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 06:04:06.010851 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] For port c7347d8a-ef46-470a-b201-f8e81c3e6789, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=c7347d8a-ef46-470a-b201-f8e81c3e6789,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 06:04:06.015297 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:06.075033 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:06.075691 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:06.077321 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] 10.222.0.54 "PUT /v2.0/ports/c7347d8a-ef46-470a-b201-f8e81c3e6789 HTTP/1.1" status: 200 len: 1093 time: 0.5879314 Dec 20 06:04:06.077914 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '47e7bff3-8129-47cb-8d1d-54ee4b98ea4b', 'tag': 'c7347d8a-ef46-470a-b201-f8e81c3e6789'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:04:06.080277 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ba6bd8d-163f-4a04-bf05-f7b7177bcb5e" -d '{"events": [{"name": "network-changed", "server_uuid": "47e7bff3-8129-47cb-8d1d-54ee4b98ea4b", "tag": "c7347d8a-ef46-470a-b201-f8e81c3e6789"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:04:06.108356 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0a955ce-9ae3-43e5-a7ab-65a5857a8012 service neutron] Pushing event updated for resources: {'Port': ['ID=c7347d8a-ef46-470a-b201-f8e81c3e6789,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:04:06.130132 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d535f5c-478d-4e6d-ac0d-9d71757d9bad req-55cb5209-16b5-4e02-bde9-52f313f1e39e tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:06.131798 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1d535f5c-478d-4e6d-ac0d-9d71757d9bad req-55cb5209-16b5-4e02-bde9-52f313f1e39e tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 943 time: 0.0924158 Dec 20 06:04:06.133315 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 06:04:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9ee313d5-a2a9-4a24-8513-ce14ec79c7f3 x-openstack-request-id: req-9ee313d5-a2a9-4a24-8513-ce14ec79c7f3 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:04:06.133611 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "47e7bff3-8129-47cb-8d1d-54ee4b98ea4b", "tag": "c7347d8a-ef46-470a-b201-f8e81c3e6789", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:04:06.133864 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-9ee313d5-a2a9-4a24-8513-ce14ec79c7f3 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:04:06.134253 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '47e7bff3-8129-47cb-8d1d-54ee4b98ea4b', 'tag': 'c7347d8a-ef46-470a-b201-f8e81c3e6789', 'status': 'completed', 'code': 200} Dec 20 06:04:06.209312 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1d535f5c-478d-4e6d-ac0d-9d71757d9bad req-56921c02-9c15-4641-8163-eee1d95516c9 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0705652 Dec 20 06:04:06.215733 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-d381e4b8-7ed0-4839-9f68-6d083abbf357 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:06.217150 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-d381e4b8-7ed0-4839-9f68-6d083abbf357 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6c4d4d4e246d4f11a44ae2ec00c29b78&device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 1096 time: 0.0613291 Dec 20 06:04:06.273550 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-e4061666-e9a0-4093-8b6e-4622ff601772 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c7347d8a-ef46-470a-b201-f8e81c3e6789 HTTP/1.1" status: 200 len: 217 time: 0.0348434 Dec 20 06:04:06.320016 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-988516d4-9f90-486d-97ca-2569e3a049a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:06.321627 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-988516d4-9f90-486d-97ca-2569e3a049a7 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2bcf78d9-c760-46c0-85ca-57868ab46b20 HTTP/1.1" status: 200 len: 854 time: 0.0413308 Dec 20 06:04:06.361747 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-01242f47-b304-4183-9a1d-d6366b278ec2 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0271173 Dec 20 06:04:06.455408 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-f1fccec7-b726-4e46-acd5-b5b652852e6c service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0815604 Dec 20 06:04:06.508095 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:06.553027 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e1c1ba0b-f3ea-4e9f-b661-5357221b5da5 req-fe4bad40-97b2-4c4e-b717-9dd9fa6a0432 service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0897064 Dec 20 06:04:06.718717 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba6bd8d-163f-4a04-bf05-f7b7177bcb5e req-67a37c63-efc7-42b3-aa66-dda765b3ee4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:06.720223 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4ba6bd8d-163f-4a04-bf05-f7b7177bcb5e req-67a37c63-efc7-42b3-aa66-dda765b3ee4f service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6c4d4d4e246d4f11a44ae2ec00c29b78&device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 1096 time: 0.0410247 Dec 20 06:04:06.826235 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba6bd8d-163f-4a04-bf05-f7b7177bcb5e req-9181a603-ae12-4418-8004-df1b8faed9d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:06.828049 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4ba6bd8d-163f-4a04-bf05-f7b7177bcb5e req-9181a603-ae12-4418-8004-df1b8faed9d5 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 HTTP/1.1" status: 200 len: 915 time: 0.1001649 Dec 20 06:04:06.870737 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4ba6bd8d-163f-4a04-bf05-f7b7177bcb5e req-ac9633ab-eb46-4ef5-9249-f72c49f90553 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c7347d8a-ef46-470a-b201-f8e81c3e6789 HTTP/1.1" status: 200 len: 217 time: 0.0348947 Dec 20 06:04:06.925203 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba6bd8d-163f-4a04-bf05-f7b7177bcb5e req-fbd7f5f4-d4fe-4492-b3bd-e20a54c6c5f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:06.926617 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4ba6bd8d-163f-4a04-bf05-f7b7177bcb5e req-fbd7f5f4-d4fe-4492-b3bd-e20a54c6c5f0 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2bcf78d9-c760-46c0-85ca-57868ab46b20 HTTP/1.1" status: 200 len: 854 time: 0.0418684 Dec 20 06:04:06.957849 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4ba6bd8d-163f-4a04-bf05-f7b7177bcb5e req-7a146806-35bf-4ed5-a0f8-94b7aa45ba0a service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0239964 Dec 20 06:04:07.049878 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4ba6bd8d-163f-4a04-bf05-f7b7177bcb5e req-ddcab3c0-60d7-44c5-90a9-dfe09a6e2650 service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821483 Dec 20 06:04:07.152686 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-4ba6bd8d-163f-4a04-bf05-f7b7177bcb5e req-73412c97-44df-4f37-822d-0b5fd35b6831 service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0896678 Dec 20 06:04:07.326348 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4faf7e0-5405-45dd-b92b-442147e79b39 req-022ec5f7-fcbe-4628-a725-1ee986370df9 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:07.327995 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f4faf7e0-5405-45dd-b92b-442147e79b39 req-022ec5f7-fcbe-4628-a725-1ee986370df9 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 943 time: 0.0482595 Dec 20 06:04:07.373670 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-f4faf7e0-5405-45dd-b92b-442147e79b39 req-57ef095f-e244-4cba-b637-19e668e559c4 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398164 Dec 20 06:04:07.577811 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:08.498424 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d555aeef-291e-48da-9611-6097c3196b77 req-2483472b-e1aa-4cd3-bd20-0c2ea4a5f8d7 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:08.500264 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d555aeef-291e-48da-9611-6097c3196b77 req-2483472b-e1aa-4cd3-bd20-0c2ea4a5f8d7 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 943 time: 0.0616772 Dec 20 06:04:08.544927 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d555aeef-291e-48da-9611-6097c3196b77 req-2a158d3d-9b20-42a1-b50a-15cdbe2750f2 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390556 Dec 20 06:04:08.780671 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:09.660645 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c7bdb6e-2562-4aa5-b284-8ffeddf0798b req-df7edfae-30b9-43ea-8dee-10469fd6445f tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:09.661988 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5c7bdb6e-2562-4aa5-b284-8ffeddf0798b req-df7edfae-30b9-43ea-8dee-10469fd6445f tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 943 time: 0.0508661 Dec 20 06:04:09.707353 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5c7bdb6e-2562-4aa5-b284-8ffeddf0798b req-1b6830e8-b1b6-4a76-a00d-007b2a4288dd tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392971 Dec 20 06:04:09.741482 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device c7347d8a-ef46-470a-b201-f8e81c3e6789 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 06:04:09.834909 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port c7347d8a-ef46-470a-b201-f8e81c3e6789, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=c7347d8a-ef46-470a-b201-f8e81c3e6789,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:04:09.846235 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': 'c7347d8a-ef46-470a-b201-f8e81c3e6789', 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9', 'port_id': 'c7347d8a-ef46-470a-b201-f8e81c3e6789', 'mac_address': 'fa:16:3e:1c:4e:96', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 402, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2bcf78d9-c760-46c0-85ca-57868ab46b20', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 06:04:09.882809 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:09.895415 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c7347d8a-ef46-470a-b201-f8e81c3e6789 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:04:09.914399 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port c7347d8a-ef46-470a-b201-f8e81c3e6789, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=c7347d8a-ef46-470a-b201-f8e81c3e6789,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:04:09.918710 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:09.963308 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=c7347d8a-ef46-470a-b201-f8e81c3e6789,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:04:10.278325 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['c7347d8a-ef46-470a-b201-f8e81c3e6789'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:04:10.821424 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad6ede47-a83c-4838-a3c9-5388de44e827 req-e6a6e84d-6bcb-42c0-88ff-1e8c24d67436 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:10.822963 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ad6ede47-a83c-4838-a3c9-5388de44e827 req-e6a6e84d-6bcb-42c0-88ff-1e8c24d67436 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 944 time: 0.0505226 Dec 20 06:04:10.873840 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ad6ede47-a83c-4838-a3c9-5388de44e827 req-d31e3e9e-6682-4ff2-b352-e8f55672e2fb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407724 Dec 20 06:04:11.742623 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device c7347d8a-ef46-470a-b201-f8e81c3e6789 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 06:04:11.788338 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port c7347d8a-ef46-470a-b201-f8e81c3e6789 completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 06:04:11.791813 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port c7347d8a-ef46-470a-b201-f8e81c3e6789 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 06:04:11.792178 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:11.867638 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:11.889491 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '47e7bff3-8129-47cb-8d1d-54ee4b98ea4b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c7347d8a-ef46-470a-b201-f8e81c3e6789'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:04:11.891707 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bcb6b323-5c91-435c-8a5c-37e1ae7b5d4c" -d '{"events": [{"server_uuid": "47e7bff3-8129-47cb-8d1d-54ee4b98ea4b", "name": "network-vif-plugged", "status": "completed", "tag": "c7347d8a-ef46-470a-b201-f8e81c3e6789"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:04:11.905657 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port c7347d8a-ef46-470a-b201-f8e81c3e6789, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=c7347d8a-ef46-470a-b201-f8e81c3e6789,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:04:11.910362 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:11.935153 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:04:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-33724ce5-12d1-44eb-aa08-d482e6e0e4eb x-openstack-request-id: req-33724ce5-12d1-44eb-aa08-d482e6e0e4eb {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:04:11.935447 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "47e7bff3-8129-47cb-8d1d-54ee4b98ea4b", "name": "network-vif-plugged", "status": "completed", "tag": "c7347d8a-ef46-470a-b201-f8e81c3e6789", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:04:11.935745 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-33724ce5-12d1-44eb-aa08-d482e6e0e4eb {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:04:11.936141 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '47e7bff3-8129-47cb-8d1d-54ee4b98ea4b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c7347d8a-ef46-470a-b201-f8e81c3e6789', 'code': 200} Dec 20 06:04:11.959226 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=c7347d8a-ef46-470a-b201-f8e81c3e6789,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:04:11.994209 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4bdba9f-6333-424d-84ab-4ec08d1faa66 req-a1c24a66-9bb4-4091-adcd-899c9a0e651e tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:11.996088 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b4bdba9f-6333-424d-84ab-4ec08d1faa66 req-a1c24a66-9bb4-4091-adcd-899c9a0e651e tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 945 time: 0.0518165 Dec 20 06:04:12.046688 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b4bdba9f-6333-424d-84ab-4ec08d1faa66 req-d6831783-c112-4114-8a3f-453910a1cf2a tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445042 Dec 20 06:04:12.166628 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecebd4b6-b10d-4b44-b7c3-b87789817504 req-cd9cf6b1-2ca9-4c93-89ef-9c375a62fbd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:12.168154 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ecebd4b6-b10d-4b44-b7c3-b87789817504 req-cd9cf6b1-2ca9-4c93-89ef-9c375a62fbd1 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 1098 time: 0.0395219 Dec 20 06:04:12.219198 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-ecebd4b6-b10d-4b44-b7c3-b87789817504 req-8992d62e-fb48-4626-965c-16dc159e2104 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360699 Dec 20 06:04:13.162606 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f36c805-25d4-48e1-aa64-9ad03e8e4c25 req-2c54a297-425f-4894-828e-2cb2b88fe64f tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:13.164098 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9f36c805-25d4-48e1-aa64-9ad03e8e4c25 req-2c54a297-425f-4894-828e-2cb2b88fe64f tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 945 time: 0.0485811 Dec 20 06:04:13.210096 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9f36c805-25d4-48e1-aa64-9ad03e8e4c25 req-0eeabbca-fbc5-4f8e-8bf3-d95d2737284e tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401833 Dec 20 06:04:14.324062 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-073cb65b-374b-4a24-9ccd-0b2dc7a88c82 req-68c02946-69cc-4071-b66b-505260f31ebd tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:14.325449 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-073cb65b-374b-4a24-9ccd-0b2dc7a88c82 req-68c02946-69cc-4071-b66b-505260f31ebd tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 945 time: 0.0503986 Dec 20 06:04:14.371744 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-073cb65b-374b-4a24-9ccd-0b2dc7a88c82 req-188061cf-cd2a-4be1-b3e2-89eb01b3809a tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394173 Dec 20 06:04:23.969355 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:04:25.053124 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-104059d6-d4a7-44ce-a4ac-9642b7fe09bc tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:25.054576 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-104059d6-d4a7-44ce-a4ac-9642b7fe09bc tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/networks?id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 HTTP/1.1" status: 200 len: 814 time: 0.1011395 Dec 20 06:04:25.068777 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-c2429c92-fd77-4f4a-9c84-92b0e56bf099 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/quotas/6c4d4d4e246d4f11a44ae2ec00c29b78 HTTP/1.1" status: 200 len: 375 time: 0.0086277 Dec 20 06:04:25.119477 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-9bc843b3-12ba-4f5e-bd95-04a27d1deec0 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c4d4d4e246d4f11a44ae2ec00c29b78&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0457642 Dec 20 06:04:25.251233 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-1be888e5-0980-4ad6-a213-6954b2b2eb13 service neutron] 10.222.0.46 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1248569 Dec 20 06:04:25.339427 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a150e8f5-2a6e-435b-b8f1-2898efb2b1b5 service neutron] 10.222.0.46 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822439 Dec 20 06:04:25.491073 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1e4a9189-7089-45d8-accc-b338d31d971a req-4f296fa0-0e27-4a0e-b9e3-16781f4a2e91 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 210 time: 0.0258880 Dec 20 06:04:26.611712 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-cc0b6402-377d-449c-9ec4-8585ec86f582 req-88683c57-4eb0-4db1-a75e-3044eecc003b tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 210 time: 0.0397439 Dec 20 06:04:26.913266 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-7c1f985a-c6d6-4f7b-80d0-bfc91447d28d tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:26.914691 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-7c1f985a-c6d6-4f7b-80d0-bfc91447d28d tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "GET /v2.0/networks?id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 HTTP/1.1" status: 200 len: 814 time: 0.3639722 Dec 20 06:04:26.936010 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Request body: {'port': {'device_id': '7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd', 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9', 'admin_state_up': True, 'tenant_id': '6c4d4d4e246d4f11a44ae2ec00c29b78'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:04:27.042924 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Made reservation on behalf of 6c4d4d4e246d4f11a44ae2ec00c29b78 for: {'port': 1} {{(pid=102445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 20 06:04:27.046535 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:27.164157 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_common [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Allocated IP 172.20.0.2 (fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9/2bcf78d9-c760-46c0-85ca-57868ab46b20/c26046c8-ab0c-42e6-827b-d9b5bbb37715) {{(pid=102445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 20 06:04:27.307498 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks [] for port, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:27.340027 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8746766757331', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:27.381210 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 is already hosted by enough agents. {{(pid=102445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 20 06:04:27.384351 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.base_scheduler [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Resources bound (agent type, host, resource id): {{(pid=102445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 20 06:04:27.387221 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['40756b7d-f349-4d4a-b6e9-cc33ae0f461e', 'a7974ee0-cb36-4f67-b838-34a1f138ec4a', 'c7347d8a-ef46-470a-b201-f8e81c3e6789'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:04:27.387861 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Received port after_create {{(pid=102445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 20 06:04:27.413531 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Pushing event updated for resources: {'Port': ['ID=c26046c8-ab0c-42e6-827b-d9b5bbb37715,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:04:27.431279 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:04:27.431666 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:04:27.432015 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:04:27.432355 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:04:27.432695 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:04:27.433031 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:04:27.433358 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:04:27.433686 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:04:27.434016 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:04:27.434340 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:04:27.434662 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:04:27.434994 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:04:27.435872 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.454189 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.456833 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.456833 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.456833 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.456833 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.456833 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.456833 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.456833 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.456833 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.456833 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.456833 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.456833 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:04:27.456833 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:04:27.456833 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:27.457698 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:27.473153 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-27221e20-f063-441e-bd5d-fb3c6d9dbd63 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5411127 Dec 20 06:04:27.492107 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.v2.base [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Request body: {'port': {'device_id': '7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-82227'}} {{(pid=102445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 20 06:04:27.543766 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:27.780646 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c893d5cf-16df-4c08-975d-542ba1d7c30a req-24b500df-16a0-46e2-967b-d761c71ef9c9 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:27.782121 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c893d5cf-16df-4c08-975d-542ba1d7c30a req-24b500df-16a0-46e2-967b-d761c71ef9c9 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 931 time: 0.0961568 Dec 20 06:04:27.873839 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-c893d5cf-16df-4c08-975d-542ba1d7c30a req-d69ce1e2-61e8-4e8c-ba3e-7e9019af0ea9 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0815351 Dec 20 06:04:27.886984 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c26046c8-ab0c-42e6-827b-d9b5bbb37715 {{(pid=102445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:04:27.895216 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:27.908495 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.provisioning_blocks [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Transition to ACTIVE for port object c26046c8-ab0c-42e6-827b-d9b5bbb37715 will not be triggered until provisioned by entity L2. {{(pid=102445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 20 06:04:27.912166 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:27.981433 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Pushing event updated for resources: {'Port': ['ID=c26046c8-ab0c-42e6-827b-d9b5bbb37715,revision_number=2']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:04:28.028324 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Attempting to bind port c26046c8-ab0c-42e6-827b-d9b5bbb37715 on host hv-cinder-82227 for vnic_type normal with profile {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 20 06:04:28.028652 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Attempting to bind port c26046c8-ab0c-42e6-827b-d9b5bbb37715 by drivers openvswitch,hyperv on host hv-cinder-82227 at level 0 using segments [{'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 20 06:04:28.028992 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Attempting to bind port c26046c8-ab0c-42e6-827b-d9b5bbb37715 on network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 06:04:28.033074 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Port c26046c8-ab0c-42e6-827b-d9b5bbb37715 on network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-82227 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 20 06:04:28.033386 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Attempting to bind port c26046c8-ab0c-42e6-827b-d9b5bbb37715 on network fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 20 06:04:28.038052 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Checking agent: {'id': 'e1b096ad-9f3e-4fcd-9fac-6bbb7e007a40', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-82227', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'started_at': datetime.datetime(2021, 12, 20, 5, 51, 37), 'heartbeat_timestamp': datetime.datetime(2021, 12, 20, 6, 4, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 20 06:04:28.038378 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Checking segment: {'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 20 06:04:28.038752 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Bound using segment: {'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'} {{(pid=102445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 20 06:04:28.039165 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.managers [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Bound port: c26046c8-ab0c-42e6-827b-d9b5bbb37715, host: hv-cinder-82227, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'effad741-91d1-454a-b4c1-664343a009d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 402, 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9'}}] {{(pid=102445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 20 06:04:28.039504 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:28.100329 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] For port c26046c8-ab0c-42e6-827b-d9b5bbb37715, host hv-cinder-82227, cleared binding levels {{(pid=102445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 20 06:04:28.103249 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] For port c26046c8-ab0c-42e6-827b-d9b5bbb37715, host hv-cinder-82227, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=c26046c8-ab0c-42e6-827b-d9b5bbb37715,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 20 06:04:28.107285 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3465161'] for port, after_update {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:28.137589 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:28.138700 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:28.140096 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] 10.222.0.54 "PUT /v2.0/ports/c26046c8-ab0c-42e6-827b-d9b5bbb37715 HTTP/1.1" status: 200 len: 1093 time: 0.6521468 Dec 20 06:04:28.142254 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd', 'tag': 'c26046c8-ab0c-42e6-827b-d9b5bbb37715'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:04:28.144410 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8a54b183-9e70-40c4-8c78-a8975287ee2b" -d '{"events": [{"name": "network-changed", "server_uuid": "7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd", "tag": "c26046c8-ab0c-42e6-827b-d9b5bbb37715"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:04:28.169948 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9f97e76-6a55-4933-9771-864209862c72 service neutron] Pushing event updated for resources: {'Port': ['ID=c26046c8-ab0c-42e6-827b-d9b5bbb37715,revision_number=3']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:04:28.248842 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 06:04:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7d49eb21-57a0-4bac-b4ed-61b569f676ff x-openstack-request-id: req-7d49eb21-57a0-4bac-b4ed-61b569f676ff {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:04:28.249156 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd", "tag": "c26046c8-ab0c-42e6-827b-d9b5bbb37715", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:04:28.249449 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-7d49eb21-57a0-4bac-b4ed-61b569f676ff {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:04:28.249873 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd', 'tag': 'c26046c8-ab0c-42e6-827b-d9b5bbb37715', 'status': 'completed', 'code': 200} Dec 20 06:04:28.259555 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-e132bee8-bf9e-4559-9803-d2e039af6370 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:28.261067 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-e132bee8-bf9e-4559-9803-d2e039af6370 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6c4d4d4e246d4f11a44ae2ec00c29b78&device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 1096 time: 0.0505047 Dec 20 06:04:28.318608 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-2bb1628e-1966-4414-9244-058c8c867cc8 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=c26046c8-ab0c-42e6-827b-d9b5bbb37715 HTTP/1.1" status: 200 len: 217 time: 0.0332758 Dec 20 06:04:28.365978 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-16d9b369-8d35-442a-a3de-07baa07dcc0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:28.367393 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-16d9b369-8d35-442a-a3de-07baa07dcc0d service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2bcf78d9-c760-46c0-85ca-57868ab46b20 HTTP/1.1" status: 200 len: 854 time: 0.0416267 Dec 20 06:04:28.403353 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-1482fe77-883d-4d6c-a95b-0a65d00c9505 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0278919 Dec 20 06:04:28.496093 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-ff797110-b466-42bf-a94b-e809f3fa0019 service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0809708 Dec 20 06:04:28.588255 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-37aebf4d-4b0c-4c8f-a1b2-3283847fe49c req-4c2e8b86-0810-459e-9a1f-a06cffcfa12d service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838158 Dec 20 06:04:28.726287 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a54b183-9e70-40c4-8c78-a8975287ee2b req-bdb7af1e-8cea-4e00-b2d6-5f2944632219 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:28.727830 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8a54b183-9e70-40c4-8c78-a8975287ee2b req-bdb7af1e-8cea-4e00-b2d6-5f2944632219 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=6c4d4d4e246d4f11a44ae2ec00c29b78&device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 1096 time: 0.0413334 Dec 20 06:04:28.817187 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a54b183-9e70-40c4-8c78-a8975287ee2b req-72211eec-8077-435d-a709-a4441ce07389 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:28.818518 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8a54b183-9e70-40c4-8c78-a8975287ee2b req-72211eec-8077-435d-a709-a4441ce07389 service neutron] 10.222.0.54 "GET /v2.0/networks?id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 HTTP/1.1" status: 200 len: 915 time: 0.0829153 Dec 20 06:04:28.858887 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8a54b183-9e70-40c4-8c78-a8975287ee2b req-e78e7048-f82c-4bb7-9180-352732dd600f service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=c26046c8-ab0c-42e6-827b-d9b5bbb37715 HTTP/1.1" status: 200 len: 217 time: 0.0331516 Dec 20 06:04:28.912229 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a54b183-9e70-40c4-8c78-a8975287ee2b req-49452c6c-4a52-46a6-b11a-68a315e6e20a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:28.913950 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8a54b183-9e70-40c4-8c78-a8975287ee2b req-49452c6c-4a52-46a6-b11a-68a315e6e20a service neutron] 10.222.0.54 "GET /v2.0/subnets?id=2bcf78d9-c760-46c0-85ca-57868ab46b20 HTTP/1.1" status: 200 len: 854 time: 0.0410707 Dec 20 06:04:28.947174 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8a54b183-9e70-40c4-8c78-a8975287ee2b req-c7b87479-3e78-4da1-8e2a-b123041a2dfe service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0251458 Dec 20 06:04:29.049916 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5840928e-cadc-4b66-8506-34d9a4ba9f1d req-be04d34c-d350-4a84-b1ae-7447694d8e06 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:29.051385 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5840928e-cadc-4b66-8506-34d9a4ba9f1d req-be04d34c-d350-4a84-b1ae-7447694d8e06 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 943 time: 0.1065474 Dec 20 06:04:29.084823 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8a54b183-9e70-40c4-8c78-a8975287ee2b req-d34ab8fa-dc73-4b06-9a4c-0b129c056cf0 service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1273794 Dec 20 06:04:29.136226 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5840928e-cadc-4b66-8506-34d9a4ba9f1d req-070c27c2-beb6-4c6f-ab44-95952c3d533c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0789113 Dec 20 06:04:29.191495 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8a54b183-9e70-40c4-8c78-a8975287ee2b req-095a2866-3aca-49b7-8fa2-f3e376770287 service neutron] 10.222.0.54 "GET /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0966575 Dec 20 06:04:29.871939 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device c26046c8-ab0c-42e6-827b-d9b5bbb37715 details requested by agent hyperv_hv-cinder-82227 with host hv-cinder-82227 {{(pid=102447) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 20 06:04:29.963967 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port c26046c8-ab0c-42e6-827b-d9b5bbb37715, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=c26046c8-ab0c-42e6-827b-d9b5bbb37715,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:04:29.975109 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Returning: {'device': 'c26046c8-ab0c-42e6-827b-d9b5bbb37715', 'network_id': 'fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9', 'port_id': 'c26046c8-ab0c-42e6-827b-d9b5bbb37715', 'mac_address': 'fa:16:3e:45:f4:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 402, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2bcf78d9-c760-46c0-85ca-57868ab46b20', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102447) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 20 06:04:30.010946 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:30.023595 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c26046c8-ab0c-42e6-827b-d9b5bbb37715 {{(pid=102447) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 20 06:04:30.041876 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port c26046c8-ab0c-42e6-827b-d9b5bbb37715, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=c26046c8-ab0c-42e6-827b-d9b5bbb37715,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:04:30.045637 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:30.094122 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=c26046c8-ab0c-42e6-827b-d9b5bbb37715,revision_number=4']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:04:30.249808 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03c72b89-e162-4620-ae29-945f324dffd1 req-738a691a-4494-493b-ad88-16bffaa47541 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:30.251298 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-03c72b89-e162-4620-ae29-945f324dffd1 req-738a691a-4494-493b-ad88-16bffaa47541 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 944 time: 0.0474830 Dec 20 06:04:30.296574 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-03c72b89-e162-4620-ae29-945f324dffd1 req-7247b59b-e151-483a-af20-4e16279d487d tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393629 Dec 20 06:04:30.425452 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['c26046c8-ab0c-42e6-827b-d9b5bbb37715'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:04:31.412015 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d3a3898-1268-481f-bdd7-b2b5845f94c6 req-63f90338-016f-4f9d-aedb-89af12c78721 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:31.413478 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2d3a3898-1268-481f-bdd7-b2b5845f94c6 req-63f90338-016f-4f9d-aedb-89af12c78721 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 944 time: 0.0515409 Dec 20 06:04:31.459029 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2d3a3898-1268-481f-bdd7-b2b5845f94c6 req-2f732183-01fe-46d1-ab1a-edcf4fb2c052 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397537 Dec 20 06:04:31.726914 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-01cc662a-8348-4f90-b4f8-49b138e6c2f4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:31.868715 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device c26046c8-ab0c-42e6-827b-d9b5bbb37715 up at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 20 06:04:31.917386 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning for port c26046c8-ab0c-42e6-827b-d9b5bbb37715 completed by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 20 06:04:31.921762 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.provisioning_blocks [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Provisioning complete for port c26046c8-ab0c-42e6-827b-d9b5bbb37715 triggered by entity L2. {{(pid=102447) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 20 06:04:31.922131 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-979398'] for port, provisioning_complete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:31.999888 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-579353'] for port, before_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:32.022112 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c26046c8-ab0c-42e6-827b-d9b5bbb37715'}] {{(pid=102447) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:04:32.024358 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c53a23967cc7dde6ca4fe92b3a7c4a0bc745d609ef83305b4e89c6ceb61f226b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a8d7a424-61b7-4f00-a10a-7e9742cd2628" -d '{"events": [{"server_uuid": "7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd", "name": "network-vif-plugged", "status": "completed", "tag": "c26046c8-ab0c-42e6-827b-d9b5bbb37715"}]}' {{(pid=102447) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:04:32.036976 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] For port c26046c8-ab0c-42e6-827b-d9b5bbb37715, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=c26046c8-ab0c-42e6-827b-d9b5bbb37715,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:04:32.041047 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8746767255534', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8746766757349', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8746766757367'] for port, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:32.092212 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Pushing event updated for resources: {'Port': ['ID=c26046c8-ab0c-42e6-827b-d9b5bbb37715,revision_number=5']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:04:32.117099 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:04:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f83e1ebf-8d2c-43ab-8d88-2e9e9a9ac8e7 x-openstack-request-id: req-f83e1ebf-8d2c-43ab-8d88-2e9e9a9ac8e7 {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:04:32.117394 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd", "name": "network-vif-plugged", "status": "completed", "tag": "c26046c8-ab0c-42e6-827b-d9b5bbb37715", "code": 200}]} {{(pid=102447) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:04:32.117648 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-f83e1ebf-8d2c-43ab-8d88-2e9e9a9ac8e7 {{(pid=102447) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:04:32.118048 dv-cinder-822278-1-iscsi neutron-server[102447]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c26046c8-ab0c-42e6-827b-d9b5bbb37715', 'code': 200} Dec 20 06:04:32.333745 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53766ac8-c4da-4587-9584-8703d40eabe7 req-237feec9-b58c-4564-85e6-927946257746 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:32.335092 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-53766ac8-c4da-4587-9584-8703d40eabe7 req-237feec9-b58c-4564-85e6-927946257746 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 1098 time: 0.0389056 Dec 20 06:04:32.377703 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-53766ac8-c4da-4587-9584-8703d40eabe7 req-987a9a95-7907-40d0-99f5-245e5fdc9289 service neutron] 10.222.0.54 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358047 Dec 20 06:04:32.568335 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751ef2b8-f98b-444b-a543-81f21993bad2 req-e8c59074-25a6-4579-be43-08946a68820b tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:32.569776 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-751ef2b8-f98b-444b-a543-81f21993bad2 req-e8c59074-25a6-4579-be43-08946a68820b tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 945 time: 0.0464430 Dec 20 06:04:32.625355 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-751ef2b8-f98b-444b-a543-81f21993bad2 req-f6964766-7218-415a-b63c-e1d41dc4ec94 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496271 Dec 20 06:04:33.745422 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4a1a087-c65f-42ff-bcf1-6331e12de98c req-16134ca1-543c-4487-aa71-7a1601cd274b tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:33.746892 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b4a1a087-c65f-42ff-bcf1-6331e12de98c req-16134ca1-543c-4487-aa71-7a1601cd274b tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 945 time: 0.0485263 Dec 20 06:04:33.794133 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-b4a1a087-c65f-42ff-bcf1-6331e12de98c req-e0f540a7-11fe-4812-8736-61d93bdc7f11 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412266 Dec 20 06:04:34.167401 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-640f45f2-8b3e-4d3c-9866-e07d54ba551b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:34.907166 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41d6f9f-44d5-4f42-9097-e968442f893b req-cfaed07b-fd6d-4cfa-8e95-371038d8c1a5 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:34.908647 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d41d6f9f-44d5-4f42-9097-e968442f893b req-cfaed07b-fd6d-4cfa-8e95-371038d8c1a5 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 945 time: 0.0467744 Dec 20 06:04:34.953496 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d41d6f9f-44d5-4f42-9097-e968442f893b req-8bf35e34-594a-4a6a-8e83-5e372c7b14b1 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390928 Dec 20 06:04:35.012535 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:36.508516 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:37.580397 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:38.807992 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:44.358729 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a3f499f5-df38-4666-bd94-998e5f9f78b7 req-a2b6df32-60a1-4da5-aed8-e0f29871ed46 service neutron] 10.222.0.54 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0421839 Dec 20 06:04:44.479460 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3f499f5-df38-4666-bd94-998e5f9f78b7 req-21a29af8-01f5-40dc-9ae9-eab81a07e235 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:44.480942 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a3f499f5-df38-4666-bd94-998e5f9f78b7 req-21a29af8-01f5-40dc-9ae9-eab81a07e235 service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 1099 time: 0.0392051 Dec 20 06:04:44.584485 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3f499f5-df38-4666-bd94-998e5f9f78b7 req-91dad088-a2d9-45ae-8c0d-5ddeb307a50d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:44.585912 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a3f499f5-df38-4666-bd94-998e5f9f78b7 req-91dad088-a2d9-45ae-8c0d-5ddeb307a50d service neutron] 10.222.0.54 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 913 time: 0.0844023 Dec 20 06:04:44.651262 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a3f499f5-df38-4666-bd94-998e5f9f78b7 req-d80e14b8-8cc3-4978-9454-43690aeedceb service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9ac5d62d-b561-4355-9ddf-44f7ab993939 HTTP/1.1" status: 200 len: 1002 time: 0.0572340 Dec 20 06:04:44.709721 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3f499f5-df38-4666-bd94-998e5f9f78b7 req-7045f96f-7e36-4fca-bbbf-a3a9a5962937 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:44.711169 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a3f499f5-df38-4666-bd94-998e5f9f78b7 req-7045f96f-7e36-4fca-bbbf-a3a9a5962937 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e HTTP/1.1" status: 200 len: 851 time: 0.0465620 Dec 20 06:04:44.767969 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3f499f5-df38-4666-bd94-998e5f9f78b7 req-e332050a-4cf1-4ba4-9650-fb2536378c5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:44.769419 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a3f499f5-df38-4666-bd94-998e5f9f78b7 req-e332050a-4cf1-4ba4-9650-fb2536378c5f service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0421031 Dec 20 06:04:44.863174 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a3f499f5-df38-4666-bd94-998e5f9f78b7 req-04331b76-8894-4ed2-a3df-32bc7ce8e932 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798466 Dec 20 06:04:44.961436 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-a3f499f5-df38-4666-bd94-998e5f9f78b7 req-e6290e0e-534b-4c0f-95f4-5874bc997682 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877044 Dec 20 06:04:46.697307 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84578f6f-e04e-4dce-80d5-75efce43a0e7 req-a605b68e-1eb5-4d78-8734-c563b1da8ded tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:46.698830 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-84578f6f-e04e-4dce-80d5-75efce43a0e7 req-a605b68e-1eb5-4d78-8734-c563b1da8ded tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 945 time: 0.0489211 Dec 20 06:04:46.746880 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-84578f6f-e04e-4dce-80d5-75efce43a0e7 req-d4c1263c-4625-4036-98b2-2bd25114087a tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416276 Dec 20 06:04:47.859661 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ca4646-12c5-4fdb-b258-cf39c1ff9f6e req-a18b6f4a-50ec-4a7e-9662-5e128fa7508d tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:47.861096 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81ca4646-12c5-4fdb-b258-cf39c1ff9f6e req-a18b6f4a-50ec-4a7e-9662-5e128fa7508d tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 945 time: 0.0463955 Dec 20 06:04:47.909310 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-81ca4646-12c5-4fdb-b258-cf39c1ff9f6e req-26f8ae9c-6375-4133-a7aa-3f0b25609fcd tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422831 Dec 20 06:04:48.595257 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c81f40-9e6b-445b-ad23-99993c83c7c4 req-07d3bde3-c3be-4ced-8588-063151d2e71c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:48.596728 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-79c81f40-9e6b-445b-ad23-99993c83c7c4 req-07d3bde3-c3be-4ced-8588-063151d2e71c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "GET /v2.0/ports?device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 945 time: 0.0466254 Dec 20 06:04:48.694324 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-79c81f40-9e6b-445b-ad23-99993c83c7c4 req-a97feec3-164c-4095-befe-4e7b6988e9c5 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Deleting port c26046c8-ab0c-42e6-827b-d9b5bbb37715 {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:04:48.694577 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-79c81f40-9e6b-445b-ad23-99993c83c7c4 req-a97feec3-164c-4095-befe-4e7b6988e9c5 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:48.784222 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-79c81f40-9e6b-445b-ad23-99993c83c7c4 req-a97feec3-164c-4095-befe-4e7b6988e9c5 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] For port c26046c8-ab0c-42e6-827b-d9b5bbb37715, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=c26046c8-ab0c-42e6-827b-d9b5bbb37715,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:04:48.784581 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-79c81f40-9e6b-445b-ad23-99993c83c7c4 req-a97feec3-164c-4095-befe-4e7b6988e9c5 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:48.796911 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-79c81f40-9e6b-445b-ad23-99993c83c7c4 req-a97feec3-164c-4095-befe-4e7b6988e9c5 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Calling delete_port for c26046c8-ab0c-42e6-827b-d9b5bbb37715 owned by compute:nova {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:04:48.922487 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-79c81f40-9e6b-445b-ad23-99993c83c7c4 req-a97feec3-164c-4095-befe-4e7b6988e9c5 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:48.950269 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a97feec3-164c-4095-befe-4e7b6988e9c5 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Pushing event deleted for resources: {'Port': ['ID=c26046c8-ab0c-42e6-827b-d9b5bbb37715,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:04:48.968661 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['40756b7d-f349-4d4a-b6e9-cc33ae0f461e', 'a7974ee0-cb36-4f67-b838-34a1f138ec4a', 'c7347d8a-ef46-470a-b201-f8e81c3e6789', 'c26046c8-ab0c-42e6-827b-d9b5bbb37715'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:04:49.013977 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-3b9f4f2d-aa56-4136-9510-34668450bc67 req-37cf1e94-d648-46bc-8a69-73e7a441ef0c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd HTTP/1.1" status: 200 len: 210 time: 0.0360823 Dec 20 06:04:49.014831 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-79c81f40-9e6b-445b-ad23-99993c83c7c4 req-a97feec3-164c-4095-befe-4e7b6988e9c5 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] No DVR routers for this DVR port c26046c8-ab0c-42e6-827b-d9b5bbb37715 on host hv-cinder-82227 {{(pid=102445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:04:49.017690 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-79c81f40-9e6b-445b-ad23-99993c83c7c4 req-a97feec3-164c-4095-befe-4e7b6988e9c5 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:49.021166 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-79c81f40-9e6b-445b-ad23-99993c83c7c4 req-a97feec3-164c-4095-befe-4e7b6988e9c5 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "DELETE /v2.0/ports/c26046c8-ab0c-42e6-827b-d9b5bbb37715 HTTP/1.1" status: 204 len: 173 time: 0.4167223 Dec 20 06:04:49.021637 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd', 'name': 'network-vif-deleted', 'tag': 'c26046c8-ab0c-42e6-827b-d9b5bbb37715'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:04:49.024574 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b3d865e-22b6-4cdc-8a64-3eeea7268b54" -d '{"events": [{"server_uuid": "7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd", "name": "network-vif-deleted", "tag": "c26046c8-ab0c-42e6-827b-d9b5bbb37715"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:04:49.064836 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:04:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-73a477f5-242c-46c6-9981-f6785dfa0694 x-openstack-request-id: req-73a477f5-242c-46c6-9981-f6785dfa0694 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:04:49.065211 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd", "name": "network-vif-deleted", "tag": "c26046c8-ab0c-42e6-827b-d9b5bbb37715", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:04:49.065653 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-73a477f5-242c-46c6-9981-f6785dfa0694 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:04:49.066247 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7c1f2d33-f8ee-4f5d-8005-c1a7cf3ffbbd', 'name': 'network-vif-deleted', 'tag': 'c26046c8-ab0c-42e6-827b-d9b5bbb37715', 'status': 'completed', 'code': 200} Dec 20 06:04:51.389967 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b44845-7746-48b6-85d3-becfef98f5ff req-e74a894c-092e-4639-ab63-8474603b7d2b tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:51.391468 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-12b44845-7746-48b6-85d3-becfef98f5ff req-e74a894c-092e-4639-ab63-8474603b7d2b tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 945 time: 0.0505321 Dec 20 06:04:51.439002 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-12b44845-7746-48b6-85d3-becfef98f5ff req-56ca1600-2440-470e-93b4-bb9f23ab3e7d tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413108 Dec 20 06:04:52.005811 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device c26046c8-ab0c-42e6-827b-d9b5bbb37715 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:04:52.025451 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: c26046c8-ab0c-42e6-827b-d9b5bbb37715 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:04:52.025795 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device c26046c8-ab0c-42e6-827b-d9b5bbb37715 not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:04:52.551745 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72b8ebc5-154d-4ac6-a8ee-56d514ffae50 req-8d97c1f9-4c23-4786-8f6b-53876a52d18d tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:52.553228 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-72b8ebc5-154d-4ac6-a8ee-56d514ffae50 req-8d97c1f9-4c23-4786-8f6b-53876a52d18d tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 945 time: 0.0471811 Dec 20 06:04:52.597958 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-72b8ebc5-154d-4ac6-a8ee-56d514ffae50 req-ae4b37ae-3c92-4956-91b1-e99baa319dcf tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389893 Dec 20 06:04:53.256434 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ae15a2-564d-4bc4-b48c-bb5ca9e1bce5 req-d6c46984-4f94-4ebc-beed-f7e689bb6a38 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:53.257836 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-47ae15a2-564d-4bc4-b48c-bb5ca9e1bce5 req-d6c46984-4f94-4ebc-beed-f7e689bb6a38 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 945 time: 0.0464938 Dec 20 06:04:53.353586 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-47ae15a2-564d-4bc4-b48c-bb5ca9e1bce5 req-704820cc-8c60-4597-84a4-bbd6e2e9cfee tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Deleting port c7347d8a-ef46-470a-b201-f8e81c3e6789 {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:04:53.353586 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-47ae15a2-564d-4bc4-b48c-bb5ca9e1bce5 req-704820cc-8c60-4597-84a4-bbd6e2e9cfee tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:53.443152 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-47ae15a2-564d-4bc4-b48c-bb5ca9e1bce5 req-704820cc-8c60-4597-84a4-bbd6e2e9cfee tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] For port c7347d8a-ef46-470a-b201-f8e81c3e6789, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=c7347d8a-ef46-470a-b201-f8e81c3e6789,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:04:53.443435 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-47ae15a2-564d-4bc4-b48c-bb5ca9e1bce5 req-704820cc-8c60-4597-84a4-bbd6e2e9cfee tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:53.456704 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-47ae15a2-564d-4bc4-b48c-bb5ca9e1bce5 req-704820cc-8c60-4597-84a4-bbd6e2e9cfee tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Calling delete_port for c7347d8a-ef46-470a-b201-f8e81c3e6789 owned by compute:nova {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:04:53.576572 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-47ae15a2-564d-4bc4-b48c-bb5ca9e1bce5 req-704820cc-8c60-4597-84a4-bbd6e2e9cfee tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:53.602290 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-704820cc-8c60-4597-84a4-bbd6e2e9cfee tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Pushing event deleted for resources: {'Port': ['ID=c7347d8a-ef46-470a-b201-f8e81c3e6789,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:04:53.613484 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['40756b7d-f349-4d4a-b6e9-cc33ae0f461e', 'a7974ee0-cb36-4f67-b838-34a1f138ec4a', 'c7347d8a-ef46-470a-b201-f8e81c3e6789'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:04:53.650061 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-47ae15a2-564d-4bc4-b48c-bb5ca9e1bce5 req-704820cc-8c60-4597-84a4-bbd6e2e9cfee tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] No DVR routers for this DVR port c7347d8a-ef46-470a-b201-f8e81c3e6789 on host hv-cinder-82227 {{(pid=102445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:04:53.653151 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-47ae15a2-564d-4bc4-b48c-bb5ca9e1bce5 req-704820cc-8c60-4597-84a4-bbd6e2e9cfee tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:53.657574 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-47ae15a2-564d-4bc4-b48c-bb5ca9e1bce5 req-704820cc-8c60-4597-84a4-bbd6e2e9cfee tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "DELETE /v2.0/ports/c7347d8a-ef46-470a-b201-f8e81c3e6789 HTTP/1.1" status: 204 len: 173 time: 0.3931148 Dec 20 06:04:53.658021 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '47e7bff3-8129-47cb-8d1d-54ee4b98ea4b', 'name': 'network-vif-deleted', 'tag': 'c7347d8a-ef46-470a-b201-f8e81c3e6789'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:04:53.660459 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-857778bb-90c5-49e6-b6f4-cb84aa54f8c9" -d '{"events": [{"server_uuid": "47e7bff3-8129-47cb-8d1d-54ee4b98ea4b", "name": "network-vif-deleted", "tag": "c7347d8a-ef46-470a-b201-f8e81c3e6789"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:04:53.704921 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-78cafab6-6ffd-4d86-b5c2-69b96bfcc9c7 req-d2104266-ba07-42fc-8061-f6bf5e764d25 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=47e7bff3-8129-47cb-8d1d-54ee4b98ea4b HTTP/1.1" status: 200 len: 210 time: 0.0346432 Dec 20 06:04:53.726881 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:04:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7a6e0b61-8912-48c2-b860-fd2c132861fc x-openstack-request-id: req-7a6e0b61-8912-48c2-b860-fd2c132861fc {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:04:53.739422 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "47e7bff3-8129-47cb-8d1d-54ee4b98ea4b", "name": "network-vif-deleted", "tag": "c7347d8a-ef46-470a-b201-f8e81c3e6789", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:04:53.739857 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-7a6e0b61-8912-48c2-b860-fd2c132861fc {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:04:53.740283 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '47e7bff3-8129-47cb-8d1d-54ee4b98ea4b', 'name': 'network-vif-deleted', 'tag': 'c7347d8a-ef46-470a-b201-f8e81c3e6789', 'status': 'completed', 'code': 200} Dec 20 06:04:54.974522 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2e5b74b-23d8-4188-a090-c977e8f183d5 req-c9cd293a-3cd0-417f-9e17-510af7b30141 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:54.975991 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e2e5b74b-23d8-4188-a090-c977e8f183d5 req-c9cd293a-3cd0-417f-9e17-510af7b30141 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 945 time: 0.0474968 Dec 20 06:04:55.020870 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-e2e5b74b-23d8-4188-a090-c977e8f183d5 req-a7906ac2-e65f-4dc9-a939-6d5fd55bf740 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390592 Dec 20 06:04:56.026396 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device c7347d8a-ef46-470a-b201-f8e81c3e6789 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:04:56.049031 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: c7347d8a-ef46-470a-b201-f8e81c3e6789 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:04:56.049296 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device c7347d8a-ef46-470a-b201-f8e81c3e6789 not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:04:56.144928 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d158bd8-d250-4308-8ea7-a54ecd7c1b39 req-abbd8de3-420e-4656-8231-ab28726ad59f tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:56.146379 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9d158bd8-d250-4308-8ea7-a54ecd7c1b39 req-abbd8de3-420e-4656-8231-ab28726ad59f tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 945 time: 0.0576508 Dec 20 06:04:56.193524 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-9d158bd8-d250-4308-8ea7-a54ecd7c1b39 req-10fbc703-9a94-4fdf-95cd-6ffc7fdd121b tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411727 Dec 20 06:04:56.525844 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df14d5e7-90f5-4bb1-876a-8ea48861fc82 req-61c1852e-618a-4482-9beb-5cb4ef3537ed tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:56.527440 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-df14d5e7-90f5-4bb1-876a-8ea48861fc82 req-61c1852e-618a-4482-9beb-5cb4ef3537ed tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "GET /v2.0/ports?device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 945 time: 0.0478804 Dec 20 06:04:56.617518 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-df14d5e7-90f5-4bb1-876a-8ea48861fc82 req-5a2e8fc1-b243-48ad-88a2-0346fd6968ec tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Deleting port a7974ee0-cb36-4f67-b838-34a1f138ec4a {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:04:56.617857 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-df14d5e7-90f5-4bb1-876a-8ea48861fc82 req-5a2e8fc1-b243-48ad-88a2-0346fd6968ec tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:56.704473 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-df14d5e7-90f5-4bb1-876a-8ea48861fc82 req-5a2e8fc1-b243-48ad-88a2-0346fd6968ec tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] For port a7974ee0-cb36-4f67-b838-34a1f138ec4a, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=a7974ee0-cb36-4f67-b838-34a1f138ec4a,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:04:56.704744 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-df14d5e7-90f5-4bb1-876a-8ea48861fc82 req-5a2e8fc1-b243-48ad-88a2-0346fd6968ec tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:56.716973 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-df14d5e7-90f5-4bb1-876a-8ea48861fc82 req-5a2e8fc1-b243-48ad-88a2-0346fd6968ec tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Calling delete_port for a7974ee0-cb36-4f67-b838-34a1f138ec4a owned by compute:nova {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:04:56.847290 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-df14d5e7-90f5-4bb1-876a-8ea48861fc82 req-5a2e8fc1-b243-48ad-88a2-0346fd6968ec tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:56.874555 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a2e8fc1-b243-48ad-88a2-0346fd6968ec tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Pushing event deleted for resources: {'Port': ['ID=a7974ee0-cb36-4f67-b838-34a1f138ec4a,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:04:56.886045 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['40756b7d-f349-4d4a-b6e9-cc33ae0f461e', 'a7974ee0-cb36-4f67-b838-34a1f138ec4a'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:04:56.917194 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-df14d5e7-90f5-4bb1-876a-8ea48861fc82 req-5a2e8fc1-b243-48ad-88a2-0346fd6968ec tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] No DVR routers for this DVR port a7974ee0-cb36-4f67-b838-34a1f138ec4a on host hv-cinder-82227 {{(pid=102445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:04:56.919707 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-df14d5e7-90f5-4bb1-876a-8ea48861fc82 req-5a2e8fc1-b243-48ad-88a2-0346fd6968ec tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:04:56.923275 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-df14d5e7-90f5-4bb1-876a-8ea48861fc82 req-5a2e8fc1-b243-48ad-88a2-0346fd6968ec tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "DELETE /v2.0/ports/a7974ee0-cb36-4f67-b838-34a1f138ec4a HTTP/1.1" status: 204 len: 173 time: 0.3895772 Dec 20 06:04:56.923822 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c', 'name': 'network-vif-deleted', 'tag': 'a7974ee0-cb36-4f67-b838-34a1f138ec4a'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:04:56.926705 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9bab3f69-8833-44d0-95c0-fa6965c48884" -d '{"events": [{"server_uuid": "9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c", "name": "network-vif-deleted", "tag": "a7974ee0-cb36-4f67-b838-34a1f138ec4a"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:04:56.968099 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:04:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c6b0e46-0cbe-4297-ab6b-b4473e9e2ea3 x-openstack-request-id: req-4c6b0e46-0cbe-4297-ab6b-b4473e9e2ea3 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:04:56.968396 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c", "name": "network-vif-deleted", "tag": "a7974ee0-cb36-4f67-b838-34a1f138ec4a", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:04:56.968649 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-4c6b0e46-0cbe-4297-ab6b-b4473e9e2ea3 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:04:56.969047 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c', 'name': 'network-vif-deleted', 'tag': 'a7974ee0-cb36-4f67-b838-34a1f138ec4a', 'status': 'completed', 'code': 200} Dec 20 06:04:57.298273 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-67b6a8e4-fe25-4536-8cf3-f48ab5844fee req-5b890eb8-1aab-4f27-b0c3-3ef9d8ce9cd7 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=9dbe4aaa-e049-4c3e-9fab-f4e3a9df991c HTTP/1.1" status: 200 len: 210 time: 0.0259271 Dec 20 06:04:59.675645 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eca7c3c-8d4e-45bf-9c3d-03fb2b777ea8 req-9fde64eb-f483-4220-9939-86cfc1dae208 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:04:59.677032 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2eca7c3c-8d4e-45bf-9c3d-03fb2b777ea8 req-9fde64eb-f483-4220-9939-86cfc1dae208 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 946 time: 0.0485189 Dec 20 06:04:59.722961 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-2eca7c3c-8d4e-45bf-9c3d-03fb2b777ea8 req-20bd61d2-3507-4b17-a713-bdb1101c4578 tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400307 Dec 20 06:05:00.051472 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device a7974ee0-cb36-4f67-b838-34a1f138ec4a no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:05:00.071916 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: a7974ee0-cb36-4f67-b838-34a1f138ec4a {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:05:00.072258 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device a7974ee0-cb36-4f67-b838-34a1f138ec4a not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:05:00.838703 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-119d33c8-6333-4baa-89e6-ce70bb5f526c req-4192bbcd-5d04-423c-85d4-f6e8133e7ccb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:00.840176 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-119d33c8-6333-4baa-89e6-ce70bb5f526c req-4192bbcd-5d04-423c-85d4-f6e8133e7ccb tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 946 time: 0.0472651 Dec 20 06:05:00.887588 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-119d33c8-6333-4baa-89e6-ce70bb5f526c req-6de47c3c-dce2-4410-9421-cdcf11da661c tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/security-groups?id=431e66e8-8619-4db8-a889-74e1d4924b6c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409100 Dec 20 06:05:00.969134 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:05:01.276182 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-941c7d2b-0f4b-40c2-8744-a5f0d2106490 req-0bb44acf-56c1-4c86-ba9d-61d7589d10ed tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:01.277587 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-941c7d2b-0f4b-40c2-8744-a5f0d2106490 req-0bb44acf-56c1-4c86-ba9d-61d7589d10ed tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 946 time: 0.0466840 Dec 20 06:05:01.362622 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-941c7d2b-0f4b-40c2-8744-a5f0d2106490 req-5551be0f-581c-4e31-8b5b-98647db7bcda tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Deleting port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:05:01.362959 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-941c7d2b-0f4b-40c2-8744-a5f0d2106490 req-5551be0f-581c-4e31-8b5b-98647db7bcda tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:01.681858 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-941c7d2b-0f4b-40c2-8744-a5f0d2106490 req-5551be0f-581c-4e31-8b5b-98647db7bcda tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] For port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=40756b7d-f349-4d4a-b6e9-cc33ae0f461e,segment=NetworkSegment(effad741-91d1-454a-b4c1-664343a009d1),segment_id=effad741-91d1-454a-b4c1-664343a009d1)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:05:01.682223 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-941c7d2b-0f4b-40c2-8744-a5f0d2106490 req-5551be0f-581c-4e31-8b5b-98647db7bcda tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:01.694801 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-941c7d2b-0f4b-40c2-8744-a5f0d2106490 req-5551be0f-581c-4e31-8b5b-98647db7bcda tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Calling delete_port for 40756b7d-f349-4d4a-b6e9-cc33ae0f461e owned by compute:nova {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:05:01.727193 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80310f51-3ff5-4579-a76b-966b5b72f757 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:01.820350 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-941c7d2b-0f4b-40c2-8744-a5f0d2106490 req-5551be0f-581c-4e31-8b5b-98647db7bcda tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:01.848409 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5551be0f-581c-4e31-8b5b-98647db7bcda tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Pushing event deleted for resources: {'Port': ['ID=40756b7d-f349-4d4a-b6e9-cc33ae0f461e,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:01.857346 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] get_ports_and_sgs() called for port_ids ['40756b7d-f349-4d4a-b6e9-cc33ae0f461e'] {{(pid=102447) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 20 06:05:01.890319 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-941c7d2b-0f4b-40c2-8744-a5f0d2106490 req-5551be0f-581c-4e31-8b5b-98647db7bcda tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] No DVR routers for this DVR port 40756b7d-f349-4d4a-b6e9-cc33ae0f461e on host hv-cinder-82227 {{(pid=102445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:05:01.892677 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-941c7d2b-0f4b-40c2-8744-a5f0d2106490 req-5551be0f-581c-4e31-8b5b-98647db7bcda tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:01.895981 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-941c7d2b-0f4b-40c2-8744-a5f0d2106490 req-5551be0f-581c-4e31-8b5b-98647db7bcda tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.54 "DELETE /v2.0/ports/40756b7d-f349-4d4a-b6e9-cc33ae0f461e HTTP/1.1" status: 204 len: 173 time: 0.6124480 Dec 20 06:05:01.896608 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a606d944-c589-452a-b51a-929526b88ef5', 'name': 'network-vif-deleted', 'tag': '40756b7d-f349-4d4a-b6e9-cc33ae0f461e'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:05:01.899319 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-734fdea9-5384-423e-9a8d-145b42dbda67" -d '{"events": [{"server_uuid": "a606d944-c589-452a-b51a-929526b88ef5", "name": "network-vif-deleted", "tag": "40756b7d-f349-4d4a-b6e9-cc33ae0f461e"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:05:01.940200 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:05:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0d88d3e-e171-4bc5-ae74-b508236a26f5 x-openstack-request-id: req-e0d88d3e-e171-4bc5-ae74-b508236a26f5 {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:05:01.940492 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a606d944-c589-452a-b51a-929526b88ef5", "name": "network-vif-deleted", "tag": "40756b7d-f349-4d4a-b6e9-cc33ae0f461e", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:05:01.940745 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-e0d88d3e-e171-4bc5-ae74-b508236a26f5 {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:05:01.941144 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a606d944-c589-452a-b51a-929526b88ef5', 'name': 'network-vif-deleted', 'tag': '40756b7d-f349-4d4a-b6e9-cc33ae0f461e', 'status': 'completed', 'code': 200} Dec 20 06:05:01.986738 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-27ef98a1-d7a4-4a38-b4ae-be0abecd8842 req-946a7559-8277-4f5f-9bd9-00eda89f42fe tempest-AttachVolumeNegativeTest-81693988 tempest-AttachVolumeNegativeTest-81693988-project] 10.222.0.46 "GET /v2.0/ports?device_id=a606d944-c589-452a-b51a-929526b88ef5 HTTP/1.1" status: 200 len: 210 time: 0.0289845 Dec 20 06:05:03.043771 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 51416) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:03.088253 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_v2 [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Deleting subnet 2bcf78d9-c760-46c0-85ca-57868ab46b20 {{(pid=102446) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 06:05:03.091817 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.123990 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8976279'] for subnet, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.161441 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.210698 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9173344', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3270978'] for subnet, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.239454 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2bcf78d9-c760-46c0-85ca-57868ab46b20,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:03.243857 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.247016 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] 10.222.0.46 "DELETE /v2.0/subnets/2bcf78d9-c760-46c0-85ca-57868ab46b20 HTTP/1.1" status: 204 len: 168 time: 0.2016673 Dec 20 06:05:03.249561 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 51420) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:03.251731 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:03.252082 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:03.252431 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:03.252770 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:03.253103 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:03.253433 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:03.253760 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:03.254087 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:03.254411 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:03.254736 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:03.255058 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:03.255376 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:03.255716 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ceb1fe-c19d-4503-a2d9-11bd8613d6cc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:03.317626 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-564b10ad-a7c9-4bf7-a9bc-33b829420f84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.392882 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-564b10ad-a7c9-4bf7-a9bc-33b829420f84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.421317 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-564b10ad-a7c9-4bf7-a9bc-33b829420f84 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9']}} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:03.430379 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-564b10ad-a7c9-4bf7-a9bc-33b829420f84 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'effad741-91d1-454a-b4c1-664343a009d1') {'for_net_delete': True} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:03.430670 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-564b10ad-a7c9-4bf7-a9bc-33b829420f84 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'effad741-91d1-454a-b4c1-664343a009d1') {} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:03.440228 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-564b10ad-a7c9-4bf7-a9bc-33b829420f84 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3457718'] for segment, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.453663 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-564b10ad-a7c9-4bf7-a9bc-33b829420f84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.459323 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-564b10ad-a7c9-4bf7-a9bc-33b829420f84 admin admin] Releasing vlan 402 on physical network physnet1 to pool {{(pid=102445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 06:05:03.459732 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-564b10ad-a7c9-4bf7-a9bc-33b829420f84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3465205'] for segment, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: warnings.warn(msg) Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: Traceback (most recent call last): Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: timer() Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: cb(*args, **kw) Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: return func(*args, **kwargs) Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: self._notify() Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: self.callback(batched_events) Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: event.method(event) Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: return f(self, *a, **k) Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._get(url).json() Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: return self.request(url, 'GET', **kwargs) Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 06:05:03.461345 dv-cinder-822278-1-iscsi neutron-server[102445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 06:05:03.512629 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-564b10ad-a7c9-4bf7-a9bc-33b829420f84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.518314 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-564b10ad-a7c9-4bf7-a9bc-33b829420f84 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.521541 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-564b10ad-a7c9-4bf7-a9bc-33b829420f84 admin admin] 10.222.0.46 "DELETE /v2.0/networks/fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9 HTTP/1.1" status: 204 len: 168 time: 0.2709246 Dec 20 06:05:03.531985 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-564b10ad-a7c9-4bf7-a9bc-33b829420f84 admin admin] Pushing event deleted for resources: {'Network': ['ID=fe7ce6b3-e15d-4e09-82c3-9e5ce8a303d9,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:03.626781 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 51424) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:03.668293 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-27485542-0fef-40be-966d-d13a7b832317 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=6c4d4d4e246d4f11a44ae2ec00c29b78&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0403514 Dec 20 06:05:03.670639 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 51426) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:03.715659 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f745f9d6-f6a7-4d9f-a4b5-8f901e9fef42 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.735798 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f745f9d6-f6a7-4d9f-a4b5-8f901e9fef42 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.785635 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f745f9d6-f6a7-4d9f-a4b5-8f901e9fef42 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.788416 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-f745f9d6-f6a7-4d9f-a4b5-8f901e9fef42 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:03.789544 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-f745f9d6-f6a7-4d9f-a4b5-8f901e9fef42 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/431e66e8-8619-4db8-a889-74e1d4924b6c HTTP/1.1" status: 204 len: 168 time: 0.1180327 Dec 20 06:05:03.797572 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f745f9d6-f6a7-4d9f-a4b5-8f901e9fef42 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=431e66e8-8619-4db8-a889-74e1d4924b6c,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:04.071100 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 40756b7d-f349-4d4a-b6e9-cc33ae0f461e no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:05:04.092691 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: 40756b7d-f349-4d4a-b6e9-cc33ae0f461e {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:05:04.092691 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 40756b7d-f349-4d4a-b6e9-cc33ae0f461e not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:05:04.168848 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-19056332-2008-4dc6-af20-4ed38d4a19d5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:05.014648 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:06.505343 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:07.582942 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:08.816158 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:12.960926 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 51540) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:13.075443 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b82c48c5-98e8-4662-9865-1f2f95bb5e55 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:13.151252 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b82c48c5-98e8-4662-9865-1f2f95bb5e55 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:13.155550 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b82c48c5-98e8-4662-9865-1f2f95bb5e55 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:13.196588 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-b82c48c5-98e8-4662-9865-1f2f95bb5e55 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=edae8a0f619f49b79e43ce0ad62793b1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2345283 Dec 20 06:05:13.197538 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b82c48c5-98e8-4662-9865-1f2f95bb5e55 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=96bcb148-176c-4a91-ac28-5a24ff617ecb,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:13.199243 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 51544) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:13.246470 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ed264da6-c87b-4323-bffd-28713aee7bc1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:13.266971 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ed264da6-c87b-4323-bffd-28713aee7bc1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:13.315864 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ed264da6-c87b-4323-bffd-28713aee7bc1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:13.318487 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-ed264da6-c87b-4323-bffd-28713aee7bc1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:13.319661 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-ed264da6-c87b-4323-bffd-28713aee7bc1 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/96bcb148-176c-4a91-ac28-5a24ff617ecb HTTP/1.1" status: 204 len: 168 time: 0.1193473 Dec 20 06:05:13.327092 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed264da6-c87b-4323-bffd-28713aee7bc1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=96bcb148-176c-4a91-ac28-5a24ff617ecb,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:14.669334 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 51584) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:14.776038 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4f994367-3937-4d2a-a7aa-6df1c17321ff admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:14.850309 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4f994367-3937-4d2a-a7aa-6df1c17321ff admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:14.854004 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-4f994367-3937-4d2a-a7aa-6df1c17321ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:14.891489 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-4f994367-3937-4d2a-a7aa-6df1c17321ff admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=b13793c7120247fbae00dc267f2ee7fb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2210417 Dec 20 06:05:14.892631 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f994367-3937-4d2a-a7aa-6df1c17321ff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=486dcffc-cae8-4d5b-b0ba-10c8fcac9871,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:14.894326 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 51588) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:14.941563 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-bcb7fbfd-84f2-4d2c-a8ae-b3965e11b5b4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:14.962065 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-bcb7fbfd-84f2-4d2c-a8ae-b3965e11b5b4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:15.007353 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-bcb7fbfd-84f2-4d2c-a8ae-b3965e11b5b4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:15.010006 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-bcb7fbfd-84f2-4d2c-a8ae-b3965e11b5b4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:15.011129 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-bcb7fbfd-84f2-4d2c-a8ae-b3965e11b5b4 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/486dcffc-cae8-4d5b-b0ba-10c8fcac9871 HTTP/1.1" status: 204 len: 168 time: 0.1151681 Dec 20 06:05:15.018829 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcb7fbfd-84f2-4d2c-a8ae-b3965e11b5b4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=486dcffc-cae8-4d5b-b0ba-10c8fcac9871,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:15.259636 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 51594) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:15.272582 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-43b5796c-e272-406e-b67b-9a73281ef135 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:15.344818 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-43b5796c-e272-406e-b67b-9a73281ef135 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:15.348294 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-43b5796c-e272-406e-b67b-9a73281ef135 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:15.388894 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-43b5796c-e272-406e-b67b-9a73281ef135 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=30d905c195a54243b0fd9667ae6f6133&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1281133 Dec 20 06:05:15.393331 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43b5796c-e272-406e-b67b-9a73281ef135 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b9963403-595a-40fd-8bc2-d249a9b5ed8f,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:15.393331 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 51596) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:15.439246 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-73eb2808-c114-41aa-9b2f-5c1a36428cfa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:15.460055 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-73eb2808-c114-41aa-9b2f-5c1a36428cfa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:15.505160 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-73eb2808-c114-41aa-9b2f-5c1a36428cfa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:15.507729 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-73eb2808-c114-41aa-9b2f-5c1a36428cfa admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:15.508835 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-73eb2808-c114-41aa-9b2f-5c1a36428cfa admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/b9963403-595a-40fd-8bc2-d249a9b5ed8f HTTP/1.1" status: 204 len: 168 time: 0.1150746 Dec 20 06:05:15.516197 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73eb2808-c114-41aa-9b2f-5c1a36428cfa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b9963403-595a-40fd-8bc2-d249a9b5ed8f,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:18.157481 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 51728) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:18.258573 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-197706cb-e9a3-4103-8102-94a96ac8d7eb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:18.331945 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-197706cb-e9a3-4103-8102-94a96ac8d7eb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:18.335421 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-197706cb-e9a3-4103-8102-94a96ac8d7eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:18.373721 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-197706cb-e9a3-4103-8102-94a96ac8d7eb admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=6da133e04fb24982b17b2912bbbe366e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2146339 Dec 20 06:05:18.374413 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-197706cb-e9a3-4103-8102-94a96ac8d7eb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1eabfcae-52a2-46d6-adb3-d4c31856e981,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:18.376510 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 51732) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:18.423755 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-1113822e-0800-4b2d-adc6-d4f660ffc8e7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:18.444286 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-1113822e-0800-4b2d-adc6-d4f660ffc8e7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:18.489405 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-1113822e-0800-4b2d-adc6-d4f660ffc8e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:18.491981 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-1113822e-0800-4b2d-adc6-d4f660ffc8e7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:18.493109 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-1113822e-0800-4b2d-adc6-d4f660ffc8e7 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/1eabfcae-52a2-46d6-adb3-d4c31856e981 HTTP/1.1" status: 204 len: 168 time: 0.1156003 Dec 20 06:05:18.500294 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1113822e-0800-4b2d-adc6-d4f660ffc8e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1eabfcae-52a2-46d6-adb3-d4c31856e981,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:18.736315 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 51738) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:18.756267 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9564493a-e024-4e88-9650-227431f828a8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:18.834478 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9564493a-e024-4e88-9650-227431f828a8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:18.838289 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9564493a-e024-4e88-9650-227431f828a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:18.875841 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-9564493a-e024-4e88-9650-227431f828a8 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=a4854593f7524482a5f20526e988f434&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1384473 Dec 20 06:05:18.876694 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9564493a-e024-4e88-9650-227431f828a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e3f1675-89fe-4b75-823d-e86e4e4421be,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:18.880924 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 51740) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:18.927907 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-394c5aa8-bbae-4580-83ad-7c12fd727bba admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:18.947921 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-394c5aa8-bbae-4580-83ad-7c12fd727bba admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:18.994047 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-394c5aa8-bbae-4580-83ad-7c12fd727bba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:18.996686 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-394c5aa8-bbae-4580-83ad-7c12fd727bba admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:18.997868 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-394c5aa8-bbae-4580-83ad-7c12fd727bba admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/7e3f1675-89fe-4b75-823d-e86e4e4421be HTTP/1.1" status: 204 len: 168 time: 0.1159728 Dec 20 06:05:19.005562 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-394c5aa8-bbae-4580-83ad-7c12fd727bba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e3f1675-89fe-4b75-823d-e86e4e4421be,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:28.934407 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 51830) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:29.034869 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:29.107729 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:29.111158 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:29.148531 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=ee4fba572a084a6ba76a27de70d8ba29&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2125220 Dec 20 06:05:29.149412 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f97ad86-327d-492d-ac6a-5892ca406e08,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:29.151229 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 51834) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:29.156374 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:29.156723 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:29.157062 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:29.157392 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:29.157718 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:29.158042 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:29.158367 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:29.158690 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:29.159011 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:29.159334 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:29.159683 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:29.160002 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:29.160322 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b3c8a3a-8710-40c7-bf71-bf21cbe48c71 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:29.201529 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-991fa3cf-08b1-42f0-ade7-7810fd10c2b1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:29.221939 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-991fa3cf-08b1-42f0-ade7-7810fd10c2b1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:29.269366 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-991fa3cf-08b1-42f0-ade7-7810fd10c2b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:29.273037 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-991fa3cf-08b1-42f0-ade7-7810fd10c2b1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:29.274351 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-991fa3cf-08b1-42f0-ade7-7810fd10c2b1 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/7f97ad86-327d-492d-ac6a-5892ca406e08 HTTP/1.1" status: 204 len: 168 time: 0.1220324 Dec 20 06:05:29.281672 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-991fa3cf-08b1-42f0-ade7-7810fd10c2b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f97ad86-327d-492d-ac6a-5892ca406e08,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:29.520513 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 51840) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:29.533125 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-04c22306-8679-45b6-bc49-304bd056352a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:29.612265 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-04c22306-8679-45b6-bc49-304bd056352a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:29.616073 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-04c22306-8679-45b6-bc49-304bd056352a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:29.655195 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-04c22306-8679-45b6-bc49-304bd056352a admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=dcc6903189b14a88844a1fbc465be5a3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1336567 Dec 20 06:05:29.656071 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04c22306-8679-45b6-bc49-304bd056352a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc02b355-d7cc-4764-a469-98a7ef575998,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:29.658658 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 51842) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:29.705291 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3c77fa1f-ea19-4bad-908e-cc0fb665dc95 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:29.725948 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3c77fa1f-ea19-4bad-908e-cc0fb665dc95 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:29.773097 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3c77fa1f-ea19-4bad-908e-cc0fb665dc95 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:29.775773 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-3c77fa1f-ea19-4bad-908e-cc0fb665dc95 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:29.776909 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-3c77fa1f-ea19-4bad-908e-cc0fb665dc95 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/cc02b355-d7cc-4764-a469-98a7ef575998 HTTP/1.1" status: 204 len: 168 time: 0.1169355 Dec 20 06:05:29.784997 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c77fa1f-ea19-4bad-908e-cc0fb665dc95 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc02b355-d7cc-4764-a469-98a7ef575998,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:31.729215 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-0af9b21a-8daa-407a-902c-c426fff5259e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:34.171096 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ae0486d1-52df-49d9-a6e1-5eed56ce112e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:35.017470 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:35.966865 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 51962) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:36.067093 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-1f221d42-fd38-4b26-803a-81e8fa27807f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.139281 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-1f221d42-fd38-4b26-803a-81e8fa27807f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.142671 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-1f221d42-fd38-4b26-803a-81e8fa27807f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.182181 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-1f221d42-fd38-4b26-803a-81e8fa27807f admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=eaed4af3176c403ab3b4e010c4ab54e1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2142053 Dec 20 06:05:36.183043 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f221d42-fd38-4b26-803a-81e8fa27807f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=72347503-0e2b-4fbf-8346-dc04d8696052,revision_number=1']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:36.184909 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 51966) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:36.234829 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aff58179-d4ee-4a3b-9e34-09bf2bd9201b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.258062 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aff58179-d4ee-4a3b-9e34-09bf2bd9201b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.302529 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aff58179-d4ee-4a3b-9e34-09bf2bd9201b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.305211 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-aff58179-d4ee-4a3b-9e34-09bf2bd9201b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.306333 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-aff58179-d4ee-4a3b-9e34-09bf2bd9201b admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/72347503-0e2b-4fbf-8346-dc04d8696052 HTTP/1.1" status: 204 len: 168 time: 0.1197617 Dec 20 06:05:36.314603 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aff58179-d4ee-4a3b-9e34-09bf2bd9201b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=72347503-0e2b-4fbf-8346-dc04d8696052,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:36.508313 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.560338 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 51972) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:36.573316 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b2403351-a0a7-4a46-abdb-fef20f817467 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.644941 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b2403351-a0a7-4a46-abdb-fef20f817467 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.648401 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b2403351-a0a7-4a46-abdb-fef20f817467 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_create {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.686386 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-b2403351-a0a7-4a46-abdb-fef20f817467 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=9cb0bbb141694fd49800ea6dfba27e1e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1249366 Dec 20 06:05:36.687106 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2403351-a0a7-4a46-abdb-fef20f817467 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f138ed6-820d-477f-a24e-3db214ad8b53,revision_number=1']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:36.689029 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 51974) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:36.736803 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9fed651d-bf50-41de-ae3c-9c35ebb86d50 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.756806 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9fed651d-bf50-41de-ae3c-9c35ebb86d50 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.801583 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9fed651d-bf50-41de-ae3c-9c35ebb86d50 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.804118 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-9fed651d-bf50-41de-ae3c-9c35ebb86d50 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:36.805238 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-9fed651d-bf50-41de-ae3c-9c35ebb86d50 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/0f138ed6-820d-477f-a24e-3db214ad8b53 HTTP/1.1" status: 204 len: 168 time: 0.1151562 Dec 20 06:05:36.812462 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fed651d-bf50-41de-ae3c-9c35ebb86d50 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f138ed6-820d-477f-a24e-3db214ad8b53,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:37.583958 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:37.666985 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 51978) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:37.820763 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-14d57124-901f-44a2-8f2b-9a2f4ef757e5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Deleting port 380619c5-15d2-403e-8d5f-10ba70ac693e {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:05:37.821104 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-14d57124-901f-44a2-8f2b-9a2f4ef757e5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:37.895675 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-14d57124-901f-44a2-8f2b-9a2f4ef757e5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:37.896005 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-14d57124-901f-44a2-8f2b-9a2f4ef757e5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:37.907693 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-14d57124-901f-44a2-8f2b-9a2f4ef757e5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Calling delete_port for 380619c5-15d2-403e-8d5f-10ba70ac693e owned by network:floatingip {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:05:37.968827 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:05:38.050138 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-14d57124-901f-44a2-8f2b-9a2f4ef757e5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:38.075621 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14d57124-901f-44a2-8f2b-9a2f4ef757e5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event deleted for resources: {'Port': ['ID=380619c5-15d2-403e-8d5f-10ba70ac693e,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:38.132161 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-14d57124-901f-44a2-8f2b-9a2f4ef757e5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for floatingip, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:38.132487 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.db.l3_db [None req-14d57124-901f-44a2-8f2b-9a2f4ef757e5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Floating IP 9e9d2f80-f23b-467a-9e6e-eef565fe2cd8 disassociated (deleted). External IP: 172.27.3.236, port: 6a3065b0-1f00-49dc-933d-3e0103b8afa7. Dec 20 06:05:38.340505 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-14d57124-901f-44a2-8f2b-9a2f4ef757e5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Router 8700450f-8a60-4f59-88d0-7c64696c2fae has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:05:38.445372 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-14d57124-901f-44a2-8f2b-9a2f4ef757e5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:05:38.449826 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-14d57124-901f-44a2-8f2b-9a2f4ef757e5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:38.456966 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae07d1f5-aa2d-4a02-ab89-65e6061968c3 None None] Sync routers for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:05:38.466003 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae07d1f5-aa2d-4a02-ab89-65e6061968c3 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:05:38.466613 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-ae07d1f5-aa2d-4a02-ab89-65e6061968c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:05:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:38.476705 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-14d57124-901f-44a2-8f2b-9a2f4ef757e5 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "DELETE /v2.0/floatingips/9e9d2f80-f23b-467a-9e6e-eef565fe2cd8 HTTP/1.1" status: 204 len: 168 time: 0.8085339 Dec 20 06:05:38.477291 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'tag': '6a3065b0-1f00-49dc-933d-3e0103b8afa7'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:05:38.479525 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5b85b291-6b59-42f4-aa7c-9dd3b3eeca17" -d '{"events": [{"name": "network-changed", "server_uuid": "d1ac4eb3-87a6-4d00-93ce-1f463d54ba82", "tag": "6a3065b0-1f00-49dc-933d-3e0103b8afa7"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:05:38.519893 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 06:05:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ca595d2b-e444-4902-a88c-2cb4cf96be7c x-openstack-request-id: req-ca595d2b-e444-4902-a88c-2cb4cf96be7c {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:05:38.520406 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d1ac4eb3-87a6-4d00-93ce-1f463d54ba82", "tag": "6a3065b0-1f00-49dc-933d-3e0103b8afa7", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:05:38.520659 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-ca595d2b-e444-4902-a88c-2cb4cf96be7c {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:05:38.521073 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'tag': '6a3065b0-1f00-49dc-933d-3e0103b8afa7', 'status': 'completed', 'code': 200} Dec 20 06:05:38.575291 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-ae07d1f5-aa2d-4a02-ab89-65e6061968c3 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:05:38.636804 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b85b291-6b59-42f4-aa7c-9dd3b3eeca17 req-34d18d73-ccf5-4dc2-817d-58278e4f06de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:38.639362 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5b85b291-6b59-42f4-aa7c-9dd3b3eeca17 req-34d18d73-ccf5-4dc2-817d-58278e4f06de service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 1098 time: 0.0715744 Dec 20 06:05:38.769879 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c03e64-6eef-43b6-8ab2-49780ca8e8d9 req-79eb9368-6550-40b6-98fd-3e9d4bf74ed1 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:38.771356 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08c03e64-6eef-43b6-8ab2-49780ca8e8d9 req-79eb9368-6550-40b6-98fd-3e9d4bf74ed1 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 945 time: 0.1026525 Dec 20 06:05:38.807492 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b85b291-6b59-42f4-aa7c-9dd3b3eeca17 req-bcfe0a28-5bdb-46b6-903d-4e1c2206a912 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:38.809187 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5b85b291-6b59-42f4-aa7c-9dd3b3eeca17 req-bcfe0a28-5bdb-46b6-903d-4e1c2206a912 service neutron] 10.222.0.54 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 913 time: 0.1317480 Dec 20 06:05:38.813851 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:38.816988 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-ae07d1f5-aa2d-4a02-ab89-65e6061968c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '8084dafe-347a-4114-b271-db1f87312b55', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.129', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 642, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:37:2c:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:02:02Z', 'updated_at': '2021-12-20T06:02:04Z', 'revision_number': 1, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:38.847718 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae07d1f5-aa2d-4a02-ab89-65e6061968c3 None None] Checking router: 8700450f-8a60-4f59-88d0-7c64696c2fae for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:05:38.855861 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae07d1f5-aa2d-4a02-ab89-65e6061968c3 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:05:38.856462 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-ae07d1f5-aa2d-4a02-ab89-65e6061968c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:05:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:38.862446 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5b85b291-6b59-42f4-aa7c-9dd3b3eeca17 req-aea13595-3d7a-4c0e-87ea-b5f1adf49d40 service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6a3065b0-1f00-49dc-933d-3e0103b8afa7 HTTP/1.1" status: 200 len: 217 time: 0.0450063 Dec 20 06:05:38.871083 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-08c03e64-6eef-43b6-8ab2-49780ca8e8d9 req-b3588d03-a2a0-4aeb-b02b-195c4c5e0fe9 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0936954 Dec 20 06:05:38.914437 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b85b291-6b59-42f4-aa7c-9dd3b3eeca17 req-b332cad6-b9f6-46c0-9091-49f78c7c8251 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:38.915927 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5b85b291-6b59-42f4-aa7c-9dd3b3eeca17 req-b332cad6-b9f6-46c0-9091-49f78c7c8251 service neutron] 10.222.0.54 "GET /v2.0/subnets?id=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e HTTP/1.1" status: 200 len: 851 time: 0.0439835 Dec 20 06:05:38.961216 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b85b291-6b59-42f4-aa7c-9dd3b3eeca17 req-79bb7704-095c-4591-9ea5-bdc869d6cf7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:38.962714 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5b85b291-6b59-42f4-aa7c-9dd3b3eeca17 req-79bb7704-095c-4591-9ea5-bdc869d6cf7b service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0399230 Dec 20 06:05:38.964540 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-ae07d1f5-aa2d-4a02-ab89-65e6061968c3 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:05:39.055725 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5b85b291-6b59-42f4-aa7c-9dd3b3eeca17 req-6542384d-db4d-400c-b1c9-47f223b95172 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851977 Dec 20 06:05:39.147620 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-5b85b291-6b59-42f4-aa7c-9dd3b3eeca17 req-463ce617-2465-42d6-a85c-fa0bfc936c14 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841491 Dec 20 06:05:39.315795 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-ae07d1f5-aa2d-4a02-ab89-65e6061968c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '8084dafe-347a-4114-b271-db1f87312b55', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.129', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 642, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:37:2c:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:02:02Z', 'updated_at': '2021-12-20T06:02:04Z', 'revision_number': 1, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:39.345243 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae07d1f5-aa2d-4a02-ab89-65e6061968c3 None None] The sync data for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi is: [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_floatingips': [{'id': '8084dafe-347a-4114-b271-db1f87312b55', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'floating_ip_address': '172.27.3.129', 'floating_network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'router_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'port_id': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 642, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'mac_address': 'fa:16:3e:37:2c:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-20T06:02:02Z', 'updated_at': '2021-12-20T06:02:04Z', 'revision_number': 1, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:05:39.562234 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f544f114-ed8d-499b-8ba1-c1f47739f893 None None] New status for floating IP 9e9d2f80-f23b-467a-9e6e-eef565fe2cd8: DOWN {{(pid=102448) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 06:05:39.994821 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cf49833-5519-45c0-ae37-c323b8972c47 req-f126e4d4-8f24-4d2f-a1f9-5c8801371bd6 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:39.998279 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0cf49833-5519-45c0-ae37-c323b8972c47 req-f126e4d4-8f24-4d2f-a1f9-5c8801371bd6 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 945 time: 0.0580328 Dec 20 06:05:40.047147 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-0cf49833-5519-45c0-ae37-c323b8972c47 req-9b309c03-2d13-4216-a683-5d13377e0074 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422513 Dec 20 06:05:40.380038 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11070744-678f-416a-b189-9d50bff11c05 req-272674b7-b680-4b74-9c4b-c119bdcce30c tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:40.381631 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-11070744-678f-416a-b189-9d50bff11c05 req-272674b7-b680-4b74-9c4b-c119bdcce30c tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 945 time: 0.0466883 Dec 20 06:05:40.468922 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-11070744-678f-416a-b189-9d50bff11c05 req-beb7e99e-5b59-4631-8eba-60f790786e4f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Deleting port 6a3065b0-1f00-49dc-933d-3e0103b8afa7 {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:05:40.469258 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-11070744-678f-416a-b189-9d50bff11c05 req-beb7e99e-5b59-4631-8eba-60f790786e4f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:40.556490 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-11070744-678f-416a-b189-9d50bff11c05 req-beb7e99e-5b59-4631-8eba-60f790786e4f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] For port 6a3065b0-1f00-49dc-933d-3e0103b8afa7, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=6a3065b0-1f00-49dc-933d-3e0103b8afa7,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:05:40.556848 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-11070744-678f-416a-b189-9d50bff11c05 req-beb7e99e-5b59-4631-8eba-60f790786e4f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:40.569486 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-11070744-678f-416a-b189-9d50bff11c05 req-beb7e99e-5b59-4631-8eba-60f790786e4f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Calling delete_port for 6a3065b0-1f00-49dc-933d-3e0103b8afa7 owned by compute:nova {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:05:40.704378 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-11070744-678f-416a-b189-9d50bff11c05 req-beb7e99e-5b59-4631-8eba-60f790786e4f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:40.729581 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beb7e99e-5b59-4631-8eba-60f790786e4f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event deleted for resources: {'Port': ['ID=6a3065b0-1f00-49dc-933d-3e0103b8afa7,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:40.772036 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-11070744-678f-416a-b189-9d50bff11c05 req-beb7e99e-5b59-4631-8eba-60f790786e4f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] No DVR routers for this DVR port 6a3065b0-1f00-49dc-933d-3e0103b8afa7 on host hv-cinder-82227 {{(pid=102445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:05:40.774456 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-11070744-678f-416a-b189-9d50bff11c05 req-beb7e99e-5b59-4631-8eba-60f790786e4f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:40.777852 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-11070744-678f-416a-b189-9d50bff11c05 req-beb7e99e-5b59-4631-8eba-60f790786e4f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "DELETE /v2.0/ports/6a3065b0-1f00-49dc-933d-3e0103b8afa7 HTTP/1.1" status: 204 len: 173 time: 0.3899133 Dec 20 06:05:40.778285 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'name': 'network-vif-deleted', 'tag': '6a3065b0-1f00-49dc-933d-3e0103b8afa7'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:05:40.780556 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-51714858-d71c-4c6f-906e-4f74ce3a61c1" -d '{"events": [{"server_uuid": "d1ac4eb3-87a6-4d00-93ce-1f463d54ba82", "name": "network-vif-deleted", "tag": "6a3065b0-1f00-49dc-933d-3e0103b8afa7"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:05:40.819946 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:05:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd12b56b-37ee-4691-901b-6b3ee4384f4a x-openstack-request-id: req-bd12b56b-37ee-4691-901b-6b3ee4384f4a {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:05:40.820238 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d1ac4eb3-87a6-4d00-93ce-1f463d54ba82", "name": "network-vif-deleted", "tag": "6a3065b0-1f00-49dc-933d-3e0103b8afa7", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:05:40.820492 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-bd12b56b-37ee-4691-901b-6b3ee4384f4a {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:05:40.820883 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd1ac4eb3-87a6-4d00-93ce-1f463d54ba82', 'name': 'network-vif-deleted', 'tag': '6a3065b0-1f00-49dc-933d-3e0103b8afa7', 'status': 'completed', 'code': 200} Dec 20 06:05:41.144292 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-522de7bb-754e-4258-a8a3-8ccb2057881b req-a3bd780b-acb1-4f3c-8b7d-849447b2b8fd tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=d1ac4eb3-87a6-4d00-93ce-1f463d54ba82 HTTP/1.1" status: 200 len: 210 time: 0.0275002 Dec 20 06:05:42.160587 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 6a3065b0-1f00-49dc-933d-3e0103b8afa7 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:05:42.180870 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: 6a3065b0-1f00-49dc-933d-3e0103b8afa7 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:05:42.181288 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 6a3065b0-1f00-49dc-933d-3e0103b8afa7 not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:05:44.415953 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 52006) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:44.566715 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-a8a401a6-816a-4a8a-9208-1a277b0768b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Deleting port d046e9ce-ddb2-463a-bbce-8adf3550c59c {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:05:44.567052 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a8a401a6-816a-4a8a-9208-1a277b0768b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:44.642002 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a8a401a6-816a-4a8a-9208-1a277b0768b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:44.642329 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a8a401a6-816a-4a8a-9208-1a277b0768b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:44.654482 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-a8a401a6-816a-4a8a-9208-1a277b0768b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Calling delete_port for d046e9ce-ddb2-463a-bbce-8adf3550c59c owned by network:floatingip {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:05:44.797498 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a8a401a6-816a-4a8a-9208-1a277b0768b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:44.823080 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8a401a6-816a-4a8a-9208-1a277b0768b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event deleted for resources: {'Port': ['ID=d046e9ce-ddb2-463a-bbce-8adf3550c59c,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:44.879864 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a8a401a6-816a-4a8a-9208-1a277b0768b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for floatingip, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:44.880197 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.db.l3_db [None req-a8a401a6-816a-4a8a-9208-1a277b0768b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Floating IP 8084dafe-347a-4114-b271-db1f87312b55 disassociated (deleted). External IP: 172.27.3.129, port: 9ac5d62d-b561-4355-9ddf-44f7ab993939. Dec 20 06:05:45.096769 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a8a401a6-816a-4a8a-9208-1a277b0768b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Router 8700450f-8a60-4f59-88d0-7c64696c2fae has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:05:45.198029 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8a401a6-816a-4a8a-9208-1a277b0768b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:05:45.203107 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-a8a401a6-816a-4a8a-9208-1a277b0768b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:45.210091 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bd659aa-41d6-4eed-8057-058ce4296147 None None] Sync routers for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:05:45.220046 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bd659aa-41d6-4eed-8057-058ce4296147 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:05:45.220664 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-5bd659aa-41d6-4eed-8057-058ce4296147 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:05:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:45.229846 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-a8a401a6-816a-4a8a-9208-1a277b0768b3 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "DELETE /v2.0/floatingips/8084dafe-347a-4114-b271-db1f87312b55 HTTP/1.1" status: 204 len: 168 time: 0.8128290 Dec 20 06:05:45.230460 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'tag': '9ac5d62d-b561-4355-9ddf-44f7ab993939'}] {{(pid=102446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:05:45.232717 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}358b6c7d34c4f8a87df808e19c2f72a1d05a2add461a27834607214409ba819e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1751b1ab-252a-4c88-8197-f67822770f3b" -d '{"events": [{"name": "network-changed", "server_uuid": "c1a7f178-881d-4b95-a506-791409e73d6b", "tag": "9ac5d62d-b561-4355-9ddf-44f7ab993939"}]}' {{(pid=102446) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:05:45.345985 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-5bd659aa-41d6-4eed-8057-058ce4296147 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:05:45.496021 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7acae4e-71cd-4ed4-8964-fe2d25f3de18 req-171355ea-b84e-45b9-bc22-2644d5773ec2 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:45.497624 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d7acae4e-71cd-4ed4-8964-fe2d25f3de18 req-171355ea-b84e-45b9-bc22-2644d5773ec2 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 946 time: 0.0562985 Dec 20 06:05:45.501411 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 20 Dec 2021 06:05:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-44d4d4c7-0028-40b4-a097-fe0cde51a27b x-openstack-request-id: req-44d4d4c7-0028-40b4-a097-fe0cde51a27b {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:05:45.501917 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c1a7f178-881d-4b95-a506-791409e73d6b", "tag": "9ac5d62d-b561-4355-9ddf-44f7ab993939", "status": "completed", "code": 200}]} {{(pid=102446) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:05:45.502029 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-44d4d4c7-0028-40b4-a097-fe0cde51a27b {{(pid=102446) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:05:45.502340 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'tag': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'status': 'completed', 'code': 200} Dec 20 06:05:45.556977 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-d7acae4e-71cd-4ed4-8964-fe2d25f3de18 req-91986134-5ae8-4dc5-b7e2-30f59d32f648 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0522661 Dec 20 06:05:45.573800 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-5bd659aa-41d6-4eed-8057-058ce4296147 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:45.592020 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1751b1ab-252a-4c88-8197-f67822770f3b req-f6151651-6eaf-4c53-bee8-f740fbe8c6ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:45.593520 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1751b1ab-252a-4c88-8197-f67822770f3b req-f6151651-6eaf-4c53-bee8-f740fbe8c6ec service neutron] 10.222.0.54 "GET /v2.0/ports?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 1099 time: 0.0472388 Dec 20 06:05:45.617362 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bd659aa-41d6-4eed-8057-058ce4296147 None None] Checking router: 8700450f-8a60-4f59-88d0-7c64696c2fae for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:05:45.626037 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bd659aa-41d6-4eed-8057-058ce4296147 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:05:45.626644 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-5bd659aa-41d6-4eed-8057-058ce4296147 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:05:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:45.688545 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1751b1ab-252a-4c88-8197-f67822770f3b req-691345ab-88de-4173-b0ac-b71f755b5ba4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:45.689917 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1751b1ab-252a-4c88-8197-f67822770f3b req-691345ab-88de-4173-b0ac-b71f755b5ba4 service neutron] 10.222.0.54 "GET /v2.0/networks?id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 200 len: 913 time: 0.0895131 Dec 20 06:05:45.732719 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-5bd659aa-41d6-4eed-8057-058ce4296147 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:05:45.732947 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1751b1ab-252a-4c88-8197-f67822770f3b req-69b7d253-bdfe-4c86-9261-485be73caeef service neutron] 10.222.0.54 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9ac5d62d-b561-4355-9ddf-44f7ab993939 HTTP/1.1" status: 200 len: 217 time: 0.0343783 Dec 20 06:05:45.780357 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1751b1ab-252a-4c88-8197-f67822770f3b req-93f59a78-6fcd-4cdd-b629-91df98d33b5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:45.781786 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1751b1ab-252a-4c88-8197-f67822770f3b req-93f59a78-6fcd-4cdd-b629-91df98d33b5e service neutron] 10.222.0.54 "GET /v2.0/subnets?id=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e HTTP/1.1" status: 200 len: 851 time: 0.0421855 Dec 20 06:05:45.830525 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1751b1ab-252a-4c88-8197-f67822770f3b req-85152f9e-a980-43fd-8af9-bd9463d30c45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:45.832030 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1751b1ab-252a-4c88-8197-f67822770f3b req-85152f9e-a980-43fd-8af9-bd9463d30c45 service neutron] 10.222.0.54 "GET /v2.0/ports?network_id=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0427027 Dec 20 06:05:45.921754 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1751b1ab-252a-4c88-8197-f67822770f3b req-a99874c1-ec0b-4f3e-8a74-82b6a99ccc29 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818696 Dec 20 06:05:45.929910 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-5bd659aa-41d6-4eed-8057-058ce4296147 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:45.961442 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bd659aa-41d6-4eed-8057-058ce4296147 None None] The sync data for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi is: [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T05:58:49Z', 'revision_number': 4, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi', '_interfaces': [{'id': 'c071b8e1-d00c-4569-8631-3a6ae482ed1a', 'name': '', 'network_id': 'ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'mac_address': 'fa:16:3e:fc:1b:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_interface', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:48Z', 'updated_at': '2021-12-20T05:58:53Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'subnets': [{'id': '41d28c9a-6c88-4c21-87ff-6f5f781d2b3e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:05:46.017039 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-1751b1ab-252a-4c88-8197-f67822770f3b req-66264556-e919-4a86-9423-334d6432c3b8 service neutron] 10.222.0.54 "GET /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876613 Dec 20 06:05:46.176965 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e5c2181-11ce-4e14-839a-570d6359e71c None None] New status for floating IP 8084dafe-347a-4114-b271-db1f87312b55: DOWN {{(pid=102448) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 20 06:05:46.681764 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8311df03-a778-4469-a4ee-302bd44e1ef6 req-0d2b0cb6-2b09-400b-b37b-19b4673dbfd2 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:46.683218 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8311df03-a778-4469-a4ee-302bd44e1ef6 req-0d2b0cb6-2b09-400b-b37b-19b4673dbfd2 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 946 time: 0.0479720 Dec 20 06:05:46.731550 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8311df03-a778-4469-a4ee-302bd44e1ef6 req-5d14921c-a5dc-4608-b383-f692e99e4c9f tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/security-groups?id=9e3980a1-6cf9-4277-a78d-dd743d8d3bde&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424039 Dec 20 06:05:47.150295 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65824389-61f0-4d01-a856-c9eb6fc03880 req-d057c721-7a53-4af4-bd03-16fdf6cfb005 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 20 06:05:47.151728 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-65824389-61f0-4d01-a856-c9eb6fc03880 req-d057c721-7a53-4af4-bd03-16fdf6cfb005 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 946 time: 0.0467930 Dec 20 06:05:47.238785 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-65824389-61f0-4d01-a856-c9eb6fc03880 req-b8039c6f-8774-42b3-a8f2-361fd6628dcb tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Deleting port 9ac5d62d-b561-4355-9ddf-44f7ab993939 {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:05:47.239117 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-65824389-61f0-4d01-a856-c9eb6fc03880 req-b8039c6f-8774-42b3-a8f2-361fd6628dcb tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:47.324623 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [req-65824389-61f0-4d01-a856-c9eb6fc03880 req-b8039c6f-8774-42b3-a8f2-361fd6628dcb tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] For port 9ac5d62d-b561-4355-9ddf-44f7ab993939, host hv-cinder-82227, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-82227',level=0,port_id=9ac5d62d-b561-4355-9ddf-44f7ab993939,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:05:47.324982 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-65824389-61f0-4d01-a856-c9eb6fc03880 req-b8039c6f-8774-42b3-a8f2-361fd6628dcb tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:47.337424 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [req-65824389-61f0-4d01-a856-c9eb6fc03880 req-b8039c6f-8774-42b3-a8f2-361fd6628dcb tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Calling delete_port for 9ac5d62d-b561-4355-9ddf-44f7ab993939 owned by compute:nova {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:05:47.461604 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-65824389-61f0-4d01-a856-c9eb6fc03880 req-b8039c6f-8774-42b3-a8f2-361fd6628dcb tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:47.487422 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8039c6f-8774-42b3-a8f2-361fd6628dcb tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event deleted for resources: {'Port': ['ID=9ac5d62d-b561-4355-9ddf-44f7ab993939,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:47.533054 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [req-65824389-61f0-4d01-a856-c9eb6fc03880 req-b8039c6f-8774-42b3-a8f2-361fd6628dcb tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] No DVR routers for this DVR port 9ac5d62d-b561-4355-9ddf-44f7ab993939 on host hv-cinder-82227 {{(pid=102445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:05:47.535467 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [req-65824389-61f0-4d01-a856-c9eb6fc03880 req-b8039c6f-8774-42b3-a8f2-361fd6628dcb tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for port, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:47.538973 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-65824389-61f0-4d01-a856-c9eb6fc03880 req-b8039c6f-8774-42b3-a8f2-361fd6628dcb tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.54 "DELETE /v2.0/ports/9ac5d62d-b561-4355-9ddf-44f7ab993939 HTTP/1.1" status: 204 len: 173 time: 0.3814509 Dec 20 06:05:47.539420 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'name': 'network-vif-deleted', 'tag': '9ac5d62d-b561-4355-9ddf-44f7ab993939'}] {{(pid=102445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 20 06:05:47.542102 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.46/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}049d9632589ff0c3d0be04bc864ad4fe5be44b0dc86f22096908e84573f0f849" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3a3b069d-73a7-43d3-8697-6ba42e016fb7" -d '{"events": [{"server_uuid": "c1a7f178-881d-4b95-a506-791409e73d6b", "name": "network-vif-deleted", "tag": "9ac5d62d-b561-4355-9ddf-44f7ab993939"}]}' {{(pid=102445) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 20 06:05:47.579984 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 20 Dec 2021 06:05:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32671187-a8a9-4645-a48b-81d6feff66de x-openstack-request-id: req-32671187-a8a9-4645-a48b-81d6feff66de {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 20 06:05:47.580276 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c1a7f178-881d-4b95-a506-791409e73d6b", "name": "network-vif-deleted", "tag": "9ac5d62d-b561-4355-9ddf-44f7ab993939", "status": "completed", "code": 200}]} {{(pid=102445) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 20 06:05:47.580636 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.46/compute/v2.1/os-server-external-events used request id req-32671187-a8a9-4645-a48b-81d6feff66de {{(pid=102445) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 20 06:05:47.581555 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c1a7f178-881d-4b95-a506-791409e73d6b', 'name': 'network-vif-deleted', 'tag': '9ac5d62d-b561-4355-9ddf-44f7ab993939', 'status': 'completed', 'code': 200} Dec 20 06:05:47.823782 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [req-8567b3fc-b5ec-49a4-a001-f17cb2abdfc8 req-6d5f59c3-319a-4083-abac-5b91ab87991d tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "GET /v2.0/ports?device_id=c1a7f178-881d-4b95-a506-791409e73d6b HTTP/1.1" status: 200 len: 210 time: 0.0262561 Dec 20 06:05:48.882715 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 52024) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:49.007133 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-6324d7b5-3e83-42ee-87fb-8a5a9e16a087 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Deleting port 441d1d30-3166-469a-8aa6-407b4f6a3c2e {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:05:49.007491 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6324d7b5-3e83-42ee-87fb-8a5a9e16a087 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:49.083155 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6324d7b5-3e83-42ee-87fb-8a5a9e16a087 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:49.083489 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6324d7b5-3e83-42ee-87fb-8a5a9e16a087 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:49.095417 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-6324d7b5-3e83-42ee-87fb-8a5a9e16a087 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Calling delete_port for 441d1d30-3166-469a-8aa6-407b4f6a3c2e owned by network:floatingip {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:05:49.225579 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6324d7b5-3e83-42ee-87fb-8a5a9e16a087 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:49.252855 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6324d7b5-3e83-42ee-87fb-8a5a9e16a087 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event deleted for resources: {'Port': ['ID=441d1d30-3166-469a-8aa6-407b4f6a3c2e,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:49.313389 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6324d7b5-3e83-42ee-87fb-8a5a9e16a087 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for floatingip, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:49.316027 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-6324d7b5-3e83-42ee-87fb-8a5a9e16a087 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-490262'] for floatingip, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:49.317157 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-6324d7b5-3e83-42ee-87fb-8a5a9e16a087 tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "DELETE /v2.0/floatingips/558b2a25-bb66-4ad7-bc1f-d0f3e9911d3d HTTP/1.1" status: 204 len: 168 time: 0.4334669 Dec 20 06:05:50.207833 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 9ac5d62d-b561-4355-9ddf-44f7ab993939 no longer exists at agent hyperv_hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:05:50.228106 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] No Port match for: 9ac5d62d-b561-4355-9ddf-44f7ab993939 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:05:50.228451 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Device 9ac5d62d-b561-4355-9ddf-44f7ab993939 not bound to the agent host hv-cinder-82227 {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:05:50.504587 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 52036) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:50.559200 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e9cc0d63-fa33-4ffb-80da-b3e8d8c231ca tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:50.583960 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e9cc0d63-fa33-4ffb-80da-b3e8d8c231ca tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:50.642966 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e9cc0d63-fa33-4ffb-80da-b3e8d8c231ca tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:50.645652 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-e9cc0d63-fa33-4ffb-80da-b3e8d8c231ca tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Publish callbacks [] for security_group, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:50.646748 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-e9cc0d63-fa33-4ffb-80da-b3e8d8c231ca tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] 10.222.0.46 "DELETE /v2.0/security-groups/9e3980a1-6cf9-4277-a78d-dd743d8d3bde HTTP/1.1" status: 204 len: 168 time: 0.1412063 Dec 20 06:05:50.656461 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9cc0d63-fa33-4ffb-80da-b3e8d8c231ca tempest-TestVolumeBootPattern-1204010419 tempest-TestVolumeBootPattern-1204010419-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e3980a1-6cf9-4277-a78d-dd743d8d3bde,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:50.697187 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 52040) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:51.164756 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-59bafd60-cf0d-4bcf-a614-6137c05f1a5e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1697024'] for router_interface, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:51.396957 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-59bafd60-cf0d-4bcf-a614-6137c05f1a5e admin admin] Deleting port c071b8e1-d00c-4569-8631-3a6ae482ed1a {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:05:51.397297 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-59bafd60-cf0d-4bcf-a614-6137c05f1a5e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:51.472084 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [None req-59bafd60-cf0d-4bcf-a614-6137c05f1a5e admin admin] For port c071b8e1-d00c-4569-8631-3a6ae482ed1a, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=c071b8e1-d00c-4569-8631-3a6ae482ed1a,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:05:51.472359 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-59bafd60-cf0d-4bcf-a614-6137c05f1a5e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:51.484778 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-59bafd60-cf0d-4bcf-a614-6137c05f1a5e admin admin] Calling delete_port for c071b8e1-d00c-4569-8631-3a6ae482ed1a owned by network:router_interface {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:05:51.884283 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-59bafd60-cf0d-4bcf-a614-6137c05f1a5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:51.915085 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59bafd60-cf0d-4bcf-a614-6137c05f1a5e admin admin] Pushing event deleted for resources: {'Port': ['ID=c071b8e1-d00c-4569-8631-3a6ae482ed1a,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:52.068112 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-59bafd60-cf0d-4bcf-a614-6137c05f1a5e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1617481', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1697260'] for router_interface, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:52.279675 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-59bafd60-cf0d-4bcf-a614-6137c05f1a5e admin admin] Router 8700450f-8a60-4f59-88d0-7c64696c2fae has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:05:52.389473 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-59bafd60-cf0d-4bcf-a614-6137c05f1a5e admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:05:52.395197 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-59bafd60-cf0d-4bcf-a614-6137c05f1a5e admin admin] 10.222.0.46 "PUT /v2.0/routers/8700450f-8a60-4f59-88d0-7c64696c2fae/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6965680 Dec 20 06:05:52.397515 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 52044) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:52.398762 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ee2a055-587a-4a04-974d-5a57d5b4ca08 None None] Sync routers for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:05:52.408821 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ee2a055-587a-4a04-974d-5a57d5b4ca08 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:05:52.409459 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-0ee2a055-587a-4a04-974d-5a57d5b4ca08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:05:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:52.499466 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] Publish callbacks [] for router, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:52.512142 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-0ee2a055-587a-4a04-974d-5a57d5b4ca08 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: dv-cinder-822278-1-iscsi {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:05:52.599365 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:52.649981 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] Deleting port af6c392d-edd1-4fbf-84ee-b0e50edcc1b6 {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:05:52.650320 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:52.691320 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-0ee2a055-587a-4a04-974d-5a57d5b4ca08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114'}], 'enable_snat': True}, 'gw_port_id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T06:05:51Z', 'revision_number': 5, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port': {'id': 'af6c392d-edd1-4fbf-84ee-b0e50edcc1b6', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:4c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.114', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:47Z', 'updated_at': '2021-12-20T05:58:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:52.719481 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ee2a055-587a-4a04-974d-5a57d5b4ca08 None None] Checking router: 8700450f-8a60-4f59-88d0-7c64696c2fae for host: dv-cinder-822278-1-iscsi {{(pid=102447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:05:52.726336 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] For port af6c392d-edd1-4fbf-84ee-b0e50edcc1b6, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=af6c392d-edd1-4fbf-84ee-b0e50edcc1b6,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:05:52.726698 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:52.727551 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ee2a055-587a-4a04-974d-5a57d5b4ca08 None None] Routers {'8700450f-8a60-4f59-88d0-7c64696c2fae'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:05:52.728170 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-0ee2a055-587a-4a04-974d-5a57d5b4ca08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:05:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['8700450f-8a60-4f59-88d0-7c64696c2fae'], 'active': True} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:52.742688 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] Calling delete_port for af6c392d-edd1-4fbf-84ee-b0e50edcc1b6 owned by network:router_gateway {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:05:52.815980 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvr_db [None req-0ee2a055-587a-4a04-974d-5a57d5b4ca08 None None] Set router 8700450f-8a60-4f59-88d0-7c64696c2fae gateway port host: None {{(pid=102447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:05:52.870757 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_hamode_db [None req-0ee2a055-587a-4a04-974d-5a57d5b4ca08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T06:05:52Z', 'revision_number': 6, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port_host': None}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:52.901544 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ee2a055-587a-4a04-974d-5a57d5b4ca08 None None] The sync data for ids ['8700450f-8a60-4f59-88d0-7c64696c2fae'] in dv-cinder-822278-1-iscsi is: [{'id': '8700450f-8a60-4f59-88d0-7c64696c2fae', 'name': 'tempest-TestVolumeBootPattern-2136067587-router', 'tenant_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:46Z', 'updated_at': '2021-12-20T06:05:52Z', 'revision_number': 6, 'project_id': '1aefc80d27d3426daae57e2b0a4cbbbb', 'gw_port_host': None}] {{(pid=102447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:05:52.901776 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:52.933593 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] Pushing event deleted for resources: {'Port': ['ID=af6c392d-edd1-4fbf-84ee-b0e50edcc1b6,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:52.991186 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1703502'] for router_gateway, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.076933 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1698526', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25973'] for router, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.079267 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.124112 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1698533'] for router, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.125274 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8700450f-8a60-4f59-88d0-7c64696c2fae {{(pid=102445) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 20 06:05:53.130296 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] Publish callbacks [] for router, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.131399 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-35ccdaca-8e28-4dfe-b48e-715ac65ba58a admin admin] 10.222.0.46 "DELETE /v2.0/routers/8700450f-8a60-4f59-88d0-7c64696c2fae HTTP/1.1" status: 204 len: 168 time: 0.7329500 Dec 20 06:05:53.134020 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 52046) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:53.178508 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.db_base_plugin_v2 [None req-d8623c52-9a54-4db1-8a61-0f8646a03497 admin admin] Deleting subnet 41d28c9a-6c88-4c21-87ff-6f5f781d2b3e {{(pid=102445) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 06:05:53.181645 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d8623c52-9a54-4db1-8a61-0f8646a03497 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.214722 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d8623c52-9a54-4db1-8a61-0f8646a03497 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3457727'] for subnet, precommit_delete_associations {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.292348 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d8623c52-9a54-4db1-8a61-0f8646a03497 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.355845 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d8623c52-9a54-4db1-8a61-0f8646a03497 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3465107', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3597782'] for subnet, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.380435 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8623c52-9a54-4db1-8a61-0f8646a03497 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=41d28c9a-6c88-4c21-87ff-6f5f781d2b3e,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:53.393760 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-d8623c52-9a54-4db1-8a61-0f8646a03497 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.393760 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-d8623c52-9a54-4db1-8a61-0f8646a03497 admin admin] 10.222.0.46 "DELETE /v2.0/subnets/41d28c9a-6c88-4c21-87ff-6f5f781d2b3e HTTP/1.1" status: 204 len: 168 time: 0.2582085 Dec 20 06:05:53.395705 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.wsgi [-] (102445) accepted ('10.222.0.46', 52048) {{(pid=102445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:53.397642 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8fbe9e27-b7e9-4b1c-8b71-24de1aa75f3c None None] Network ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 06:05:53.463987 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.521713 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Deleting port 5f243c0c-704a-40b7-b2f2-53e6f999503f {{(pid=102445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:05:53.522050 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.563606 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] DHCP port deletion for ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 request from dv-cinder-822278-1-iscsi {{(pid=102447) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 20 06:05:53.584351 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.db [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] For port 5f243c0c-704a-40b7-b2f2-53e6f999503f, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=5f243c0c-704a-40b7-b2f2-53e6f999503f,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:05:53.584706 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.598288 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.plugin [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Calling delete_port for 5f243c0c-704a-40b7-b2f2-53e6f999503f owned by network:dhcp {{(pid=102445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:05:53.616113 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Deleting port 5f243c0c-704a-40b7-b2f2-53e6f999503f {{(pid=102447) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:05:53.616643 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.682800 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.db [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] For port 5f243c0c-704a-40b7-b2f2-53e6f999503f, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=5f243c0c-704a-40b7-b2f2-53e6f999503f,segment=NetworkSegment(843466c5-3ffc-45e2-aa9c-b62cf8d89afd),segment_id=843466c5-3ffc-45e2-aa9c-b62cf8d89afd)] {{(pid=102447) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:05:53.683283 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3465158'] for port, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.683537 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.698796 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Calling delete_port for 5f243c0c-704a-40b7-b2f2-53e6f999503f owned by network:dhcp {{(pid=102447) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:05:53.712723 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] No DVR routers for this DVR port 5f243c0c-704a-40b7-b2f2-53e6f999503f on host dv-cinder-822278-1-iscsi {{(pid=102445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:05:53.716450 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Pushing event deleted for resources: {'Port': ['ID=5f243c0c-704a-40b7-b2f2-53e6f999503f,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:53.790343 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.811123 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6']}} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:53.820747 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '843466c5-3ffc-45e2-aa9c-b62cf8d89afd') {'for_net_delete': True} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:53.821036 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.services.segments.db [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '843466c5-3ffc-45e2-aa9c-b62cf8d89afd') {} {{(pid=102445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:53.835846 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3457718'] for segment, before_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.848941 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.855221 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Releasing vlan 448 on physical network physnet1 to pool {{(pid=102445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 06:05:53.855661 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3465205'] for segment, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: Traceback (most recent call last): Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: timer() Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: cb(*args, **kw) Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: return func(*args, **kwargs) Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: self._notify() Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: self.callback(batched_events) Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: event.method(event) Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: return f(self, *a, **k) Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._get(url).json() Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: return self.request(url, 'GET', **kwargs) Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 06:05:53.857386 dv-cinder-822278-1-iscsi neutron-server[102445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 06:05:53.909669 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340'] for port, after_delete {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.917700 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.923108 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron_lib.callbacks.manager [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:53.926350 dv-cinder-822278-1-iscsi neutron-server[102445]: INFO neutron.wsgi [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] 10.222.0.46 "DELETE /v2.0/networks/ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6 HTTP/1.1" status: 204 len: 168 time: 0.5297139 Dec 20 06:05:53.929485 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 52050) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:53.938716 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Pushing event deleted for resources: {'Port': ['ID=5f243c0c-704a-40b7-b2f2-53e6f999503f,revision_number=None']} {{(pid=102447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:53.940428 dv-cinder-822278-1-iscsi neutron-server[102445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-083db9c2-1f0f-4bfb-98bf-365adcd2a7c3 admin admin] Pushing event deleted for resources: {'Network': ['ID=ec0ba289-05a0-4b4e-ab28-d4aedfca5cc6,revision_number=None']} {{(pid=102445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:53.943056 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] No DVR routers for this DVR port 5f243c0c-704a-40b7-b2f2-53e6f999503f on host dv-cinder-822278-1-iscsi {{(pid=102447) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:05:53.949780 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:53.950132 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:53.950478 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:53.951391 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:53.951754 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:53.952086 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:53.952417 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:53.952740 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:53.953063 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:53.953394 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:53.954008 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:53.954358 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:53.954718 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-207a6b18-7d5a-4773-a69a-d092849e6849 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-822278-1-iscsi {{(pid=102447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 20 06:05:54.183893 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device af6c392d-edd1-4fbf-84ee-b0e50edcc1b6 no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:05:54.204871 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: af6c392d-edd1-4fbf-84ee-b0e50edcc1b6 {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:05:54.205216 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device af6c392d-edd1-4fbf-84ee-b0e50edcc1b6 not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:05:54.205627 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device c071b8e1-d00c-4569-8631-3a6ae482ed1a no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:05:54.224013 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: c071b8e1-d00c-4569-8631-3a6ae482ed1a {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:05:54.224362 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device c071b8e1-d00c-4569-8631-3a6ae482ed1a not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:05:54.224769 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 5f243c0c-704a-40b7-b2f2-53e6f999503f no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:05:54.246286 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 5f243c0c-704a-40b7-b2f2-53e6f999503f {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:05:54.246626 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 5f243c0c-704a-40b7-b2f2-53e6f999503f not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:05:54.275404 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2a00e370-199a-4438-9823-632b8c79d437 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1697024'] for router_interface, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:54.508069 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-2a00e370-199a-4438-9823-632b8c79d437 admin admin] Deleting port ebbdc4a9-0881-4586-8531-cde9c9ac026a {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:05:54.508313 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2a00e370-199a-4438-9823-632b8c79d437 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:54.844696 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-2a00e370-199a-4438-9823-632b8c79d437 admin admin] For port ebbdc4a9-0881-4586-8531-cde9c9ac026a, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=ebbdc4a9-0881-4586-8531-cde9c9ac026a,segment=NetworkSegment(3dde54c0-d21a-4029-a188-85abe638860e),segment_id=3dde54c0-d21a-4029-a188-85abe638860e)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:05:54.844967 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2a00e370-199a-4438-9823-632b8c79d437 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:54.857137 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-2a00e370-199a-4438-9823-632b8c79d437 admin admin] Calling delete_port for ebbdc4a9-0881-4586-8531-cde9c9ac026a owned by network:router_interface {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:05:55.038387 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2a00e370-199a-4438-9823-632b8c79d437 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:55.066670 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a00e370-199a-4438-9823-632b8c79d437 admin admin] Pushing event deleted for resources: {'Port': ['ID=ebbdc4a9-0881-4586-8531-cde9c9ac026a,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:55.230088 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-2a00e370-199a-4438-9823-632b8c79d437 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1617481', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1697260'] for router_interface, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:55.438593 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2a00e370-199a-4438-9823-632b8c79d437 admin admin] Router 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 has already been hosted by L3 agent a6650f1d-0dce-4da6-a543-3a9c31d4884d {{(pid=102446) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 20 06:05:55.540550 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2a00e370-199a-4438-9823-632b8c79d437 admin admin] Notify agent at l3_agent.dv-cinder-822278-1-iscsi the message routers_updated {{(pid=102446) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 20 06:05:55.547031 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-2a00e370-199a-4438-9823-632b8c79d437 admin admin] 10.222.0.46 "PUT /v2.0/routers/4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6155310 Dec 20 06:05:55.548568 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 52052) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:55.551682 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57784275-2b0e-43d2-9520-6bdfbdc8033e None None] Sync routers for ids ['4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'] in dv-cinder-822278-1-iscsi {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 20 06:05:55.562082 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57784275-2b0e-43d2-9520-6bdfbdc8033e None None] Routers {'4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:05:55.562689 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-57784275-2b0e-43d2-9520-6bdfbdc8033e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:05:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:55.648967 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] Publish callbacks [] for router, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:55.663115 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-57784275-2b0e-43d2-9520-6bdfbdc8033e None None] Set router 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 gateway port host: dv-cinder-822278-1-iscsi {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:05:55.760716 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:55.813638 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] Deleting port 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:05:55.813977 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:55.890535 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] For port 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=7269a2ab-2dd4-4b8b-b1bf-536003a0d27b,segment=NetworkSegment(33a54534-46f6-4df5-9e55-51864e25c4b0),segment_id=33a54534-46f6-4df5-9e55-51864e25c4b0)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:05:55.890896 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:55.903246 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] Calling delete_port for 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b owned by network:router_gateway {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:05:55.927117 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-57784275-2b0e-43d2-9520-6bdfbdc8033e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'name': 'tempest-TestVolumeBootPattern-714357623-router', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'external_fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.131'}], 'enable_snat': True}, 'gw_port_id': '7269a2ab-2dd4-4b8b-b1bf-536003a0d27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T06:05:54Z', 'revision_number': 5, 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'gw_port': {'id': '7269a2ab-2dd4-4b8b-b1bf-536003a0d27b', 'name': '', 'network_id': '2e5c289b-6b36-4be8-98bd-7afaf0da3344', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:c8:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'ip_address': '172.27.3.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-822278-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T05:58:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '13c80048-1854-452a-96f1-f7b3d8117ba4', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-822278-1-iscsi'}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:55.952694 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57784275-2b0e-43d2-9520-6bdfbdc8033e None None] Checking router: 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 for host: dv-cinder-822278-1-iscsi {{(pid=102448) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 20 06:05:55.961133 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57784275-2b0e-43d2-9520-6bdfbdc8033e None None] Routers {'4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'} bound to L3 agent in host dv-cinder-822278-1-iscsi {{(pid=102448) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 20 06:05:55.961768 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-57784275-2b0e-43d2-9520-6bdfbdc8033e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-822278-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-20T05:45:34Z,description=,heartbeat_timestamp=2021-12-20T06:05:34Z,host='dv-cinder-822278-1-iscsi',id=a6650f1d-0dce-4da6-a543-3a9c31d4884d,load=0,resource_versions=,resources_synced=,started_at=2021-12-20T05:45:34Z,topic='l3_agent')) {'router_ids': ['4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'], 'active': True} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:56.047231 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_dvr_db [None req-57784275-2b0e-43d2-9520-6bdfbdc8033e None None] Set router 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 gateway port host: None {{(pid=102448) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 20 06:05:56.067499 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.105038 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] Pushing event deleted for resources: {'Port': ['ID=7269a2ab-2dd4-4b8b-b1bf-536003a0d27b,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:56.112838 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.l3_hamode_db [None req-57784275-2b0e-43d2-9520-6bdfbdc8033e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'name': 'tempest-TestVolumeBootPattern-714357623-router', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T06:05:55Z', 'revision_number': 6, 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'gw_port_host': None}], 'dv-cinder-822278-1-iscsi', False) {} {{(pid=102448) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:56.139391 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57784275-2b0e-43d2-9520-6bdfbdc8033e None None] The sync data for ids ['4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5'] in dv-cinder-822278-1-iscsi is: [{'id': '4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5', 'name': 'tempest-TestVolumeBootPattern-714357623-router', 'tenant_id': 'd020afd8bc604ba292b2ea20a846895b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-20T05:58:51Z', 'updated_at': '2021-12-20T06:05:55Z', 'revision_number': 6, 'project_id': 'd020afd8bc604ba292b2ea20a846895b', 'gw_port_host': None}] {{(pid=102448) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 20 06:05:56.176899 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1703502'] for router_gateway, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.268215 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1698526', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25973'] for router, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.270291 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.311206 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1698533'] for router, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.311762 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 {{(pid=102446) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 20 06:05:56.316074 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] Publish callbacks [] for router, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.317286 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-b0dd9759-c51c-43a8-86a2-3ee5dd12c662 admin admin] 10.222.0.46 "DELETE /v2.0/routers/4b8f3a9c-5b91-4dcd-aabd-4020de42c4d5 HTTP/1.1" status: 204 len: 168 time: 0.7678099 Dec 20 06:05:56.319822 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 52054) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:56.366041 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.db_base_plugin_v2 [None req-14764e30-8a39-405c-a031-103813c14d59 admin admin] Deleting subnet ed59ecbe-71dc-425e-a0db-d530f6b7243d {{(pid=102446) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 20 06:05:56.369095 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-14764e30-8a39-405c-a031-103813c14d59 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.404807 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-14764e30-8a39-405c-a031-103813c14d59 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8976279'] for subnet, precommit_delete_associations {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.478233 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-14764e30-8a39-405c-a031-103813c14d59 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-967124'] for subnet, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.533308 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-14764e30-8a39-405c-a031-103813c14d59 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-967085', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2002614', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-9173344', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3270978'] for subnet, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.563754 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14764e30-8a39-405c-a031-103813c14d59 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ed59ecbe-71dc-425e-a0db-d530f6b7243d,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:56.565733 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-14764e30-8a39-405c-a031-103813c14d59 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for subnet, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.570870 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-14764e30-8a39-405c-a031-103813c14d59 admin admin] 10.222.0.46 "DELETE /v2.0/subnets/ed59ecbe-71dc-425e-a0db-d530f6b7243d HTTP/1.1" status: 204 len: 168 time: 0.2482567 Dec 20 06:05:56.571476 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 52056) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:56.574248 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13eba73c-d067-4b47-94d3-8a4d975be351 None None] Network bc6ff48e-9cc3-4803-8a65-7ec1d02b5478 requested from dv-cinder-822278-1-iscsi {{(pid=102447) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 20 06:05:56.645628 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-593152'] for network, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.698660 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Deleting port e2360595-d33d-441e-96cb-793e58e8deda {{(pid=102446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 20 06:05:56.698995 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8746767152249'] for port, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.762131 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.db [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] For port e2360595-d33d-441e-96cb-793e58e8deda, host dv-cinder-822278-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-822278-1-iscsi',level=0,port_id=e2360595-d33d-441e-96cb-793e58e8deda,segment=NetworkSegment(3dde54c0-d21a-4029-a188-85abe638860e),segment_id=3dde54c0-d21a-4029-a188-85abe638860e)] {{(pid=102446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 20 06:05:56.762402 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1994988'] for port, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.774732 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.plugin [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Calling delete_port for e2360595-d33d-441e-96cb-793e58e8deda owned by network:dhcp {{(pid=102446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 20 06:05:56.850477 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-580564', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-473782', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8746767255516', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8746766757340', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-9173301'] for port, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.879232 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Pushing event deleted for resources: {'Port': ['ID=e2360595-d33d-441e-96cb-793e58e8deda,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:56.882426 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] No DVR routers for this DVR port e2360595-d33d-441e-96cb-793e58e8deda on host dv-cinder-822278-1-iscsi {{(pid=102446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 20 06:05:56.936596 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14b80aa2-a572-4594-9120-63c00adb2680 None None] DHCP port deletion for bc6ff48e-9cc3-4803-8a65-7ec1d02b5478 request from dv-cinder-822278-1-iscsi {{(pid=102447) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 20 06:05:56.953457 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-981313', 'neutron.services.segments.db._delete_segments_for_network-8746767306123'] for network, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:56.973361 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bc6ff48e-9cc3-4803-8a65-7ec1d02b5478']}} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:56.983017 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3dde54c0-d21a-4029-a188-85abe638860e') {'for_net_delete': True} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:56.983310 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.services.segments.db [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3dde54c0-d21a-4029-a188-85abe638860e') {} {{(pid=102446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 20 06:05:56.992464 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8746767314068', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8976286'] for segment, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:57.006493 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495'] for segment, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:57.012561 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Releasing vlan 435 on physical network physnet1 to pool {{(pid=102446) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 20 06:05:57.012887 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-968495', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-9173254'] for segment, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: Traceback (most recent call last): Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: timer() Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: cb(*args, **kw) Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: return func(*args, **kwargs) Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: self._notify() Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: self.callback(batched_events) Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: event.method(event) Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: aggregate_uuid = self.p_client.list_aggregates( Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: return f(self, *a, **k) Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._get(url).json() Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: return self.request(url, 'GET', **kwargs) Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: base_url = self.get_endpoint(auth, allow=allow, Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 20 06:05:57.015273 dv-cinder-822278-1-iscsi neutron-server[102446]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 20 06:05:57.074406 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-981334', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1977178', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1617502', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1703538'] for network, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:57.080599 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1617580'] for network, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:57.086099 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] 10.222.0.46 "DELETE /v2.0/networks/bc6ff48e-9cc3-4803-8a65-7ec1d02b5478 HTTP/1.1" status: 204 len: 168 time: 0.5113654 Dec 20 06:05:57.094475 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cdbb023-a75a-48a5-a4b1-8e04cf91acdd admin admin] Pushing event deleted for resources: {'Network': ['ID=bc6ff48e-9cc3-4803-8a65-7ec1d02b5478,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:57.199715 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 52060) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:57.239376 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-d4ef0b77-da84-4a2c-8ede-d8757b515f58 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=1aefc80d27d3426daae57e2b0a4cbbbb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0384686 Dec 20 06:05:57.241979 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 52062) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:57.287410 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e081cd97-a7d9-4f87-866f-cba08994dd52 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:57.308769 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e081cd97-a7d9-4f87-866f-cba08994dd52 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:57.373683 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e081cd97-a7d9-4f87-866f-cba08994dd52 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:57.376686 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-e081cd97-a7d9-4f87-866f-cba08994dd52 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:57.378924 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-e081cd97-a7d9-4f87-866f-cba08994dd52 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/da71868c-172f-49f8-9415-ef9f75cc2d46 HTTP/1.1" status: 204 len: 168 time: 0.1349800 Dec 20 06:05:57.390250 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e081cd97-a7d9-4f87-866f-cba08994dd52 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da71868c-172f-49f8-9415-ef9f75cc2d46,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:57.692858 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 52068) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:57.733716 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-116555ec-d1bb-495f-86dc-4581f45008f9 admin admin] 10.222.0.46 "GET /v2.0/security-groups?tenant_id=d020afd8bc604ba292b2ea20a846895b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0396943 Dec 20 06:05:57.736233 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.wsgi [-] (102446) accepted ('10.222.0.46', 52070) {{(pid=102446) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 20 06:05:57.781891 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ad1293ed-ba8b-44ce-8d0c-94d5df1f8113 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:57.801847 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ad1293ed-ba8b-44ce-8d0c-94d5df1f8113 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:57.846985 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ad1293ed-ba8b-44ce-8d0c-94d5df1f8113 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974411'] for security_group, after_delete {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:57.849576 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron_lib.callbacks.manager [None req-ad1293ed-ba8b-44ce-8d0c-94d5df1f8113 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:05:57.850686 dv-cinder-822278-1-iscsi neutron-server[102446]: INFO neutron.wsgi [None req-ad1293ed-ba8b-44ce-8d0c-94d5df1f8113 admin admin] 10.222.0.46 "DELETE /v2.0/security-groups/56ddba2d-7f91-41e7-aa0e-3abce3ca8c18 HTTP/1.1" status: 204 len: 168 time: 0.1135592 Dec 20 06:05:57.857928 dv-cinder-822278-1-iscsi neutron-server[102446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad1293ed-ba8b-44ce-8d0c-94d5df1f8113 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56ddba2d-7f91-41e7-aa0e-3abce3ca8c18,revision_number=None']} {{(pid=102446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 20 06:05:58.210989 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:05:58.230840 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:05:58.231185 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device 7269a2ab-2dd4-4b8b-b1bf-536003a0d27b not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:05:58.231636 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device e2360595-d33d-441e-96cb-793e58e8deda no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:05:58.250623 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: e2360595-d33d-441e-96cb-793e58e8deda {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:05:58.250967 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device e2360595-d33d-441e-96cb-793e58e8deda not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:05:58.251359 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device ebbdc4a9-0881-4586-8531-cde9c9ac026a no longer exists at agent ovs-agent-dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 20 06:05:58.269838 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.plugin [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] No Port match for: ebbdc4a9-0881-4586-8531-cde9c9ac026a {{(pid=102447) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 20 06:05:58.270179 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron.plugins.ml2.rpc [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Device ebbdc4a9-0881-4586-8531-cde9c9ac026a not bound to the agent host dv-cinder-822278-1-iscsi {{(pid=102447) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 20 06:06:01.733616 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-de8edd81-ebbb-4149-bcae-1b3c82a97ceb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:06:04.174164 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ea6984dc-f680-465d-aeb4-fe34089bfa84 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:06:05.020759 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:06:06.511638 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:06:07.585934 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:06:08.828137 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:06:14.968005 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:06:31.735107 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-b64f570f-998d-4e89-82f9-cc7f63eb59e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:06:34.174808 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f55153a2-ae81-4532-a9f5-2614b9b6fc4d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:06:35.023383 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:06:36.516833 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:06:37.588072 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:06:38.827136 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:06:51.966712 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:07:01.737193 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-b4970d68-babc-4c3e-973a-84cc44307697 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:07:04.175753 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-e7c27aa9-f6f1-4ad2-a0f6-7c70cfcd3023 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:07:05.025482 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:07:06.519486 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:07:07.590250 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:07:08.837130 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:07:28.965464 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:07:31.741003 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eaf20dc2-403e-4d13-bfb2-de4afeabcae2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:07:34.176136 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-51a1a07b-09a4-481a-ab53-50d94b5a2c03 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:07:35.029017 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:07:36.522449 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:07:37.591015 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:07:38.837924 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:08:01.742594 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f13618de-a8ed-40e6-8d9e-1f334c301cd7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:08:04.176613 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-4ee4fa4c-8008-4418-a505-f3e545c2a01d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:08:05.031578 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:08:05.964669 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:08:06.524248 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:08:07.594724 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:08:08.836523 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:08:31.744055 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-9815fec4-8c51-4c27-82ee-8580d935b401 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:08:34.177975 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-d3a92322-c06f-4708-bd67-c51e4c426e0c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:08:35.033907 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:08:36.526577 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:08:37.596712 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:08:38.837201 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:08:42.964200 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:09:01.745603 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-d260ffc1-7153-422c-98dd-44a914c1c612 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:09:04.179654 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-bea1d0e7-eb24-455b-88be-b10ff551a0b5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:09:05.036997 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:09:06.529889 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:09:07.598435 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:09:08.835086 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:09:19.963842 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:09:31.749232 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-778e8315-ca0b-4f40-b92f-6d890a5d1716 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:09:34.180644 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-a6ade37f-f2aa-4913-bd8e-ca0d378426b5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:09:35.040372 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:09:36.531786 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:09:37.600009 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:09:38.835750 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:09:56.963390 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:10:01.751194 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-abc4d19a-3d11-4497-8e82-b4761a3cc790 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:10:04.182081 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-4c85b34a-5d98-4f26-85c4-2ab879c8127f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:10:05.044939 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:10:06.534595 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:10:07.600967 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:10:08.834445 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:10:31.752033 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-6d29ee91-974c-4d0e-b28e-e9535884b2ff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:10:33.962742 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 20 06:10:34.183294 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f4061b51-f215-4321-a73e-33874d6c4ca4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:10:35.045078 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:10:36.536417 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:10:37.602225 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:10:38.839802 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:11:01.752579 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-f021bbe2-5c74-4d9e-b143-cd2954937e57 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:11:04.185388 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-cb2ae61d-127c-4531-9ea3-cbe3a719b83e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:11:05.047523 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-40af509f-7f02-4b6d-b8d8-9ba237a3357c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:11:06.539735 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-ad93af89-8ec7-4979-82d9-88c5c576787a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:11:07.609178 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-80afca03-e169-4125-addd-042a20e4e5f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:11:08.833782 dv-cinder-822278-1-iscsi neutron-server[102447]: DEBUG neutron_lib.callbacks.manager [None req-eb37d277-50c1-4a2d-902f-a8bd830df718 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8746767306078', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-979351'] for agent, after_update {{(pid=102447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 20 06:11:10.962532 dv-cinder-822278-1-iscsi neutron-server[102448]: DEBUG neutron.db.agents_db [None req-933d83ae-62ff-4b39-acc3-5d2243eeb938 None None] Agent healthcheck: found 6 active agents {{(pid=102448) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}